Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 654539 Details for
Bug 881947
3.2 [vdsm] getDeviceList is failing with vdsm 4.10.2-1
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm.log file with the failure.
vdsm.log (text/x-log), 3.09 MB, created by
Eyal Edri
on 2012-11-29 20:38:32 UTC
(
hide
)
Description:
vdsm.log file with the failure.
Filename:
MIME Type:
Creator:
Eyal Edri
Created:
2012-11-29 20:38:32 UTC
Size:
3.09 MB
patch
obsolete
>MainThread::INFO::2012-11-29 11:01:21,517::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2012-11-29 11:01:21,530::task::588::TaskManager.Task::(_updateState) Task=`ae0a2d72-0b30-44f3-89ef-f915b8193887`::moving from state init -> state preparing >MainThread::INFO::2012-11-29 11:01:21,531::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2012-11-29 11:01:21,531::storageServer::641::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2012-11-29 11:01:21,535::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,537::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,539::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,541::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,542::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,544::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,546::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,548::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,549::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,551::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,553::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,554::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,556::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,558::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,559::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,561::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,563::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,564::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,566::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,568::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,569::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,571::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,573::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,574::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,576::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,578::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,579::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,581::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,583::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,584::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,586::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,588::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,589::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,591::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,593::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,594::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,596::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,598::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,599::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,601::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,603::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,604::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,606::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,608::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:01:21,693::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2012-11-29 11:01:21,693::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2012-11-29 11:01:21,694::task::1172::TaskManager.Task::(prepare) Task=`ae0a2d72-0b30-44f3-89ef-f915b8193887`::finished: None >MainThread::DEBUG::2012-11-29 11:01:21,694::task::588::TaskManager.Task::(_updateState) Task=`ae0a2d72-0b30-44f3-89ef-f915b8193887`::moving from state preparing -> state finished >MainThread::DEBUG::2012-11-29 11:01:21,694::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2012-11-29 11:01:21,694::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2012-11-29 11:01:21,695::task::978::TaskManager.Task::(_decref) Task=`ae0a2d72-0b30-44f3-89ef-f915b8193887`::ref 0 aborting False >MainThread::INFO::2012-11-29 11:01:21,695::vdsm::75::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2012-11-29 11:01:21,695::vdsm::78::vds::(run) <_MainThread(MainThread, started 139644601464576)> >MainThread::INFO::2012-11-29 11:01:21,696::vdsm::78::vds::(run) <Thread(libvirtEventLoop, started daemon 139644513990400)> >MainThread::INFO::2012-11-29 11:01:21,696::vdsm::78::vds::(run) <_DummyThread(Dummy-2659, started daemon 139642663855872)> >MainThread::INFO::2012-11-29 11:01:21,696::vdsm::78::vds::(run) <WorkerThread(9194d4cb-7bf5-4add-afcd-4b9130a59b9a, started daemon 139643985053440)> >MainThread::INFO::2012-11-29 11:01:21,696::vdsm::78::vds::(run) <WorkerThread(44f86aba-75d8-4aec-8d93-fbbc825ac384, started daemon 139644016523008)> >MainThread::INFO::2012-11-29 11:01:21,697::vdsm::78::vds::(run) <WorkerThread(2ed885ab-c0d9-46d9-a7ec-755f30132f4f, started daemon 139643995543296)> >MainThread::INFO::2012-11-29 11:01:21,697::vdsm::78::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139643592890112)> >MainThread::INFO::2012-11-29 11:01:21,697::vdsm::78::vds::(run) <WorkerThread(2f2ead55-e0a5-42a1-8194-dd8b15be12d9, started daemon 139644006033152)> >MainThread::INFO::2012-11-29 11:01:21,697::vdsm::78::vds::(run) <WorkerThread(e71f2afc-6d54-470a-a275-7a31584d4653, started daemon 139644370863872)> >MainThread::INFO::2012-11-29 11:01:21,698::vdsm::78::vds::(run) <WorkerThread(96e9b345-6736-4cf3-9d9a-e6e9eac6f321, started daemon 139644381353728)> >MainThread::INFO::2012-11-29 11:01:21,698::vdsm::78::vds::(run) <WorkerThread(d7283444-b78e-464c-92c1-7d9bf6d90539, started daemon 139644391843584)> >MainThread::INFO::2012-11-29 11:01:21,698::vdsm::78::vds::(run) <WorkerThread(3d67b31a-ff99-4475-9442-7b6b95ff80f8, started daemon 139644402333440)> >MainThread::INFO::2012-11-29 11:01:21,698::vdsm::78::vds::(run) <WorkerThread(9925ba8e-96a9-47e6-ab9f-3ac60a90cfbe, started daemon 139644412823296)> >MainThread::INFO::2012-11-29 11:01:21,699::vdsm::78::vds::(run) <WorkerThread(b3fbc172-b2ba-4f3d-8518-770a6ba02f79, started daemon 139643974563584)> >MainThread::INFO::2012-11-29 11:06:48,338::vdsm::70::vds::(run) I am the actual vdsm 4.9-44.0 >MainThread::DEBUG::2012-11-29 11:06:49,162::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2012-11-29 11:06:49,163::threadPool::45::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2012-11-29 11:06:49,186::fileUtils::181::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2012-11-29 11:06:50,513::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,515::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,516::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,518::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,520::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,522::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,524::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,526::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,528::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,530::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,532::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,534::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,537::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,539::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,541::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,543::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,545::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,547::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,549::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,551::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,553::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,555::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,557::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,559::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,561::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,564::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,565::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,567::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,569::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,571::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,573::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,575::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,577::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,580::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,582::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,583::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,585::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,587::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,590::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,592::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,594::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,597::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,599::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,602::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 11:06:50,711::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /bin/cat /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2012-11-29 11:06:50,942::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2012-11-29 11:06:50,943::multipath::108::Storage.Multipath::(isEnabled) Downrev multipath.conf detected, upgrade required >MainThread::DEBUG::2012-11-29 11:06:50,943::misc::528::Storage.Misc::(rotateFiles) dir: /etc, prefixName: multipath.conf, versions: 5 >MainThread::DEBUG::2012-11-29 11:06:50,944::misc::549::Storage.Misc::(rotateFiles) versions found: [] >MainThread::DEBUG::2012-11-29 11:06:50,945::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /bin/cp /tmp/tmpOBxY_G /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2012-11-29 11:06:50,963::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 11:06:50,964::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2012-11-29 11:06:50,979::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 11:06:50,980::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/service multipathd restart' (cwd None) >MainThread::DEBUG::2012-11-29 11:06:51,148::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 11:06:51,149::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2012-11-29 11:06:51,297::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 11:06:51,302::hsm::407::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2012-11-29 11:06:51,306::hsm::439::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2012-11-29 11:06:51,306::hsm::440::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2012-11-29 11:06:51,306::hsm::442::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2012-11-29 11:06:51,330::hsm::485::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >Thread-12::DEBUG::2012-11-29 11:06:51,330::lvm::319::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >MainThread::INFO::2012-11-29 11:06:51,331::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >Thread-12::DEBUG::2012-11-29 11:06:51,334::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-12::DEBUG::2012-11-29 11:06:51,486::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 11:06:51,487::lvm::342::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:51,487::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:51,488::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >MainThread::DEBUG::2012-11-29 11:06:51,610::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/pgrep -xf ksmd' (cwd None) >Thread-12::DEBUG::2012-11-29 11:06:51,629::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 11:06:51,629::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:51,630::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >MainThread::DEBUG::2012-11-29 11:06:51,684::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2012-11-29 11:06:51,685::ksm::40::vds::(__init__) starting ksm monitor thread, ksm pid is 99 >KsmMonitor::DEBUG::2012-11-29 11:06:51,686::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2012-11-29 11:06:51,687::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2012-11-29 11:06:51,692::vmChannels::127::vds::(run) Starting VM channels listener thread. >Thread-12::DEBUG::2012-11-29 11:06:51,769::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 11:06:51,769::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-12::DEBUG::2012-11-29 11:06:51,770::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 11:06:51,770::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-12::DEBUG::2012-11-29 11:06:51,770::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 11:06:51,771::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2012-11-29 11:06:51,922::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-12::DEBUG::2012-11-29 11:06:51,923::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-12::DEBUG::2012-11-29 11:06:51,924::supervdsm::100::SuperVdsmProxy::(_start) Launching Super Vdsm >Thread-12::DEBUG::2012-11-29 11:06:51,924::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 937a38bf-3a24-4f2c-beac-abfa62602ccb 2805' (cwd None) >MainThread::DEBUG::2012-11-29 11:06:52,376::supervdsmServer::271::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2012-11-29 11:06:52,377::supervdsmServer::275::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2012-11-29 11:06:52,377::supervdsmServer::278::SuperVdsm.Server::(main) Creating PID file >MainThread::DEBUG::2012-11-29 11:06:52,377::supervdsmServer::285::SuperVdsm.Server::(main) Cleaning old socket >MainThread::DEBUG::2012-11-29 11:06:52,378::supervdsmServer::289::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2012-11-29 11:06:52,378::supervdsmServer::294::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2012-11-29 11:06:52,380::supervdsmServer::306::SuperVdsm.Server::(main) Started serving super vdsm object >Thread-12::DEBUG::2012-11-29 11:06:53,929::supervdsm::153::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainProcess|Thread-12::DEBUG::2012-11-29 11:06:53,950::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 11:06:53,953::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 11:06:53,956::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 11:06:53,959::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 11:06:53,961::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 11:06:53,964::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 11:06:53,967::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-12::DEBUG::2012-11-29 11:06:55,972::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-12::DEBUG::2012-11-29 11:06:56,046::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 11:06:56,047::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:56,051::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:56,051::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:56,052::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:56,052::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:56,052::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 11:06:56,053::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-12::WARNING::2012-11-29 11:06:56,053::fileUtils::181::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2012-11-29 11:06:57,756::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2012-11-29 11:06:57,757::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2012-11-29 11:06:57,796::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2012-11-29 11:09:14,750::BindingXMLRPC::894::vds::(wrapper) client [10.35.19.51]::call getCapabilities with () {} >Thread-14::DEBUG::2012-11-29 11:09:15,014::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" qemu-img-rhev' (cwd None) >Thread-14::DEBUG::2012-11-29 11:09:15,035::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2012-11-29 11:09:15,036::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" qemu-kvm-rhev' (cwd None) >Thread-14::DEBUG::2012-11-29 11:09:15,056::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2012-11-29 11:09:15,056::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" vdsm' (cwd None) >Thread-14::DEBUG::2012-11-29 11:09:15,070::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2012-11-29 11:09:15,071::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" spice-server' (cwd None) >Thread-14::DEBUG::2012-11-29 11:09:15,085::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2012-11-29 11:09:15,085::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" libvirt' (cwd None) >Thread-14::DEBUG::2012-11-29 11:09:15,101::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2012-11-29 11:09:15,319::BindingXMLRPC::900::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'spice-server': {'release': '10.el6', 'buildtime': '1337611492', 'version': '0.10.1'}, 'vdsm': {'release': '44.0.el6_3', 'buildtime': '1353357597', 'version': '4.9.6'}, 'qemu-kvm': {'release': '2.295.el6_3.5', 'buildtime': '1350906200', 'version': '0.12.1.2'}, 'libvirt': {'release': '21.el6_3.6', 'buildtime': '1352736961', 'version': '0.9.10'}, 'qemu-img': {'release': '2.295.el6_3.5', 'buildtime': '1350906200', 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.148.42', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '10.35.148.42', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6C:FF:CB:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6C:FF:CB:90', 'speed': 1000}}, 'software_revision': '44.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_Penryn,model_Westmere', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'memSize': '11901', 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.9', 'cpuSpeed': '2400.005', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0', '3.1'], 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.3.0', u'pc', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.3.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-15::DEBUG::2012-11-29 11:09:15,515::BindingXMLRPC::894::vds::(wrapper) client [10.35.19.51]::call getCapabilities with () {} >Thread-15::DEBUG::2012-11-29 11:09:15,545::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" qemu-img-rhev' (cwd None) >Thread-15::DEBUG::2012-11-29 11:09:15,564::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2012-11-29 11:09:15,565::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" qemu-kvm-rhev' (cwd None) >Thread-15::DEBUG::2012-11-29 11:09:15,584::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2012-11-29 11:09:15,585::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" vdsm' (cwd None) >Thread-15::DEBUG::2012-11-29 11:09:15,599::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2012-11-29 11:09:15,600::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" spice-server' (cwd None) >Thread-15::DEBUG::2012-11-29 11:09:15,614::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2012-11-29 11:09:15,614::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/rpm -q --qf "%{NAME}\t%{VERSION}\t%{RELEASE}\t%{BUILDTIME}\n" libvirt' (cwd None) >Thread-15::DEBUG::2012-11-29 11:09:15,630::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2012-11-29 11:09:15,631::BindingXMLRPC::900::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'spice-server': {'release': '10.el6', 'buildtime': '1337611492', 'version': '0.10.1'}, 'vdsm': {'release': '44.0.el6_3', 'buildtime': '1353357597', 'version': '4.9.6'}, 'qemu-kvm': {'release': '2.295.el6_3.5', 'buildtime': '1350906200', 'version': '0.12.1.2'}, 'libvirt': {'release': '21.el6_3.6', 'buildtime': '1352736961', 'version': '0.9.10'}, 'qemu-img': {'release': '2.295.el6_3.5', 'buildtime': '1350906200', 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.148.42', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '10.35.148.42', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6C:FF:CB:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6C:FF:CB:90', 'speed': 1000}}, 'software_revision': '44.0', 'management_ip': '', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_Penryn,model_Westmere', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'memSize': '11901', 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.9', 'cpuSpeed': '2400.005', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0', '3.1'], 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.3.0', u'pc', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.3.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.51'}} >Thread-18::DEBUG::2012-11-29 11:09:19,513::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-18::DEBUG::2012-11-29 11:09:19,514::task::588::TaskManager.Task::(_updateState) Task=`5acac4cb-e3f3-44c8-91ea-7ff60d54ce57`::moving from state init -> state preparing >Thread-18::INFO::2012-11-29 11:09:19,514::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-18::INFO::2012-11-29 11:09:19,515::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-18::DEBUG::2012-11-29 11:09:19,515::task::1172::TaskManager.Task::(prepare) Task=`5acac4cb-e3f3-44c8-91ea-7ff60d54ce57`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-18::DEBUG::2012-11-29 11:09:19,515::task::588::TaskManager.Task::(_updateState) Task=`5acac4cb-e3f3-44c8-91ea-7ff60d54ce57`::moving from state preparing -> state finished >Thread-18::DEBUG::2012-11-29 11:09:19,516::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2012-11-29 11:09:19,516::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2012-11-29 11:09:19,516::task::978::TaskManager.Task::(_decref) Task=`5acac4cb-e3f3-44c8-91ea-7ff60d54ce57`::ref 0 aborting False >Thread-19::DEBUG::2012-11-29 11:09:19,572::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-19::DEBUG::2012-11-29 11:09:19,573::task::588::TaskManager.Task::(_updateState) Task=`148fed78-61f4-4195-8abc-4e942ec63669`::moving from state init -> state preparing >Thread-19::INFO::2012-11-29 11:09:19,573::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-19::DEBUG::2012-11-29 11:09:19,599::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391' (cwd None) >Thread-19::INFO::2012-11-29 11:09:19,840::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-19::DEBUG::2012-11-29 11:09:19,841::task::1172::TaskManager.Task::(prepare) Task=`148fed78-61f4-4195-8abc-4e942ec63669`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-19::DEBUG::2012-11-29 11:09:19,841::task::588::TaskManager.Task::(_updateState) Task=`148fed78-61f4-4195-8abc-4e942ec63669`::moving from state preparing -> state finished >Thread-19::DEBUG::2012-11-29 11:09:19,842::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2012-11-29 11:09:19,842::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2012-11-29 11:09:19,842::task::978::TaskManager.Task::(_decref) Task=`148fed78-61f4-4195-8abc-4e942ec63669`::ref 0 aborting False >Thread-20::DEBUG::2012-11-29 11:09:19,906::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-20::DEBUG::2012-11-29 11:09:19,907::task::588::TaskManager.Task::(_updateState) Task=`bc843872-9176-42e5-a697-39455db505bf`::moving from state init -> state preparing >Thread-20::INFO::2012-11-29 11:09:19,907::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', options=None) >Thread-20::DEBUG::2012-11-29 11:09:19,907::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-20::DEBUG::2012-11-29 11:09:19,908::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-20::DEBUG::2012-11-29 11:09:19,908::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-20::DEBUG::2012-11-29 11:09:19,908::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-20::DEBUG::2012-11-29 11:09:19,909::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-20::DEBUG::2012-11-29 11:09:19,920::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-20::DEBUG::2012-11-29 11:09:19,920::misc::1054::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-20::DEBUG::2012-11-29 11:09:19,922::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-20::DEBUG::2012-11-29 11:09:20,926::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-20::DEBUG::2012-11-29 11:09:21,930::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-20::DEBUG::2012-11-29 11:09:22,933::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-20::DEBUG::2012-11-29 11:09:23,937::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-20::DEBUG::2012-11-29 11:09:24,940::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-20::DEBUG::2012-11-29 11:09:25,943::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-24::DEBUG::2012-11-29 11:09:26,098::task::588::TaskManager.Task::(_updateState) Task=`34d2f1d7-6f5f-4787-a4df-fc74bc2e616c`::moving from state init -> state preparing >Thread-24::INFO::2012-11-29 11:09:26,098::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-24::INFO::2012-11-29 11:09:26,099::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-24::DEBUG::2012-11-29 11:09:26,099::task::1172::TaskManager.Task::(prepare) Task=`34d2f1d7-6f5f-4787-a4df-fc74bc2e616c`::finished: {} >Thread-24::DEBUG::2012-11-29 11:09:26,099::task::588::TaskManager.Task::(_updateState) Task=`34d2f1d7-6f5f-4787-a4df-fc74bc2e616c`::moving from state preparing -> state finished >Thread-24::DEBUG::2012-11-29 11:09:26,100::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2012-11-29 11:09:26,100::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2012-11-29 11:09:26,100::task::978::TaskManager.Task::(_decref) Task=`34d2f1d7-6f5f-4787-a4df-fc74bc2e616c`::ref 0 aborting False >Thread-20::DEBUG::2012-11-29 11:09:27,947::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-20::DEBUG::2012-11-29 11:09:28,018::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2012-11-29 11:09:28,019::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2012-11-29 11:09:28,019::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2012-11-29 11:09:28,019::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2012-11-29 11:09:28,020::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2012-11-29 11:09:28,020::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2012-11-29 11:09:28,020::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2012-11-29 11:09:28,021::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-20::DEBUG::2012-11-29 11:09:28,021::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-20::DEBUG::2012-11-29 11:09:28,022::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-20::DEBUG::2012-11-29 11:09:28,171::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-20::DEBUG::2012-11-29 11:09:28,172::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-20::INFO::2012-11-29 11:09:28,230::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-20::DEBUG::2012-11-29 11:09:28,231::task::1172::TaskManager.Task::(prepare) Task=`bc843872-9176-42e5-a697-39455db505bf`::finished: {'domlist': []} >Thread-20::DEBUG::2012-11-29 11:09:28,231::task::588::TaskManager.Task::(_updateState) Task=`bc843872-9176-42e5-a697-39455db505bf`::moving from state preparing -> state finished >Thread-20::DEBUG::2012-11-29 11:09:28,231::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2012-11-29 11:09:28,232::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2012-11-29 11:09:28,232::task::978::TaskManager.Task::(_decref) Task=`bc843872-9176-42e5-a697-39455db505bf`::ref 0 aborting False >Thread-32::DEBUG::2012-11-29 11:09:28,379::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-32::DEBUG::2012-11-29 11:09:28,380::task::588::TaskManager.Task::(_updateState) Task=`271785fd-a28d-429d-a056-d4d113845143`::moving from state init -> state preparing >Thread-32::INFO::2012-11-29 11:09:28,380::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', domainName='DataDomainRest', typeSpecificArg='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', domClass=1, domVersion='3', options=None) >Thread-32::DEBUG::2012-11-29 11:09:28,380::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-32::DEBUG::2012-11-29 11:09:28,381::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free f1008a0c-010a-45a0-b80c-f5e8514a76e7' (cwd None) >Thread-32::DEBUG::2012-11-29 11:09:28,512::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = ' Volume group "f1008a0c-010a-45a0-b80c-f5e8514a76e7" not found\n'; <rc> = 5 >Thread-32::WARNING::2012-11-29 11:09:28,513::lvm::356::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "f1008a0c-010a-45a0-b80c-f5e8514a76e7" not found'] >Thread-32::DEBUG::2012-11-29 11:09:28,514::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-32::INFO::2012-11-29 11:09:28,518::nfsSD::66::Storage.StorageDomain::(create) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 domainName=DataDomainRest remotePath=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391 domClass=1 >Thread-32::DEBUG::2012-11-29 11:09:28,647::persistentDict::185::Storage.PersistentDict::(__init__) Created a persistant dict with FileMetadataRW backend >Thread-32::DEBUG::2012-11-29 11:09:28,648::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-32::WARNING::2012-11-29 11:09:28,648::persistentDict::248::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-32::DEBUG::2012-11-29 11:09:28,648::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >Thread-32::DEBUG::2012-11-29 11:09:28,648::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >Thread-32::DEBUG::2012-11-29 11:09:28,649::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9781f821ebfcefba63d51b5523965278b6a4f7f2'] >Thread-32::DEBUG::2012-11-29 11:09:28,652::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >Thread-32::DEBUG::2012-11-29 11:09:28,653::fileSD::124::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-32::DEBUG::2012-11-29 11:09:28,653::persistentDict::185::Storage.PersistentDict::(__init__) Created a persistant dict with FileMetadataRW backend >Thread-32::DEBUG::2012-11-29 11:09:28,655::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9781f821ebfcefba63d51b5523965278b6a4f7f2'] >Thread-32::DEBUG::2012-11-29 11:09:28,657::fileSD::447::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-32::DEBUG::2012-11-29 11:09:28,658::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS' >Thread-32::DEBUG::2012-11-29 11:09:28,658::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS' >Thread-32::DEBUG::2012-11-29 11:09:28,695::sd::363::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-32::INFO::2012-11-29 11:09:28,695::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-32::DEBUG::2012-11-29 11:09:28,696::task::1172::TaskManager.Task::(prepare) Task=`271785fd-a28d-429d-a056-d4d113845143`::finished: None >Thread-32::DEBUG::2012-11-29 11:09:28,696::task::588::TaskManager.Task::(_updateState) Task=`271785fd-a28d-429d-a056-d4d113845143`::moving from state preparing -> state finished >Thread-32::DEBUG::2012-11-29 11:09:28,696::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-32::DEBUG::2012-11-29 11:09:28,697::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2012-11-29 11:09:28,697::task::978::TaskManager.Task::(_decref) Task=`271785fd-a28d-429d-a056-d4d113845143`::ref 0 aborting False >Thread-38::DEBUG::2012-11-29 11:09:28,735::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-38::DEBUG::2012-11-29 11:09:28,735::task::588::TaskManager.Task::(_updateState) Task=`9d2416ce-657c-40e7-a7fb-cb94c099628a`::moving from state init -> state preparing >Thread-38::INFO::2012-11-29 11:09:28,736::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', options=None) >Thread-38::DEBUG::2012-11-29 11:09:28,736::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`58169b15-8506-4c6a-bb34-3fde77594107`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-38::DEBUG::2012-11-29 11:09:28,737::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-38::DEBUG::2012-11-29 11:09:28,737::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2012-11-29 11:09:28,737::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`58169b15-8506-4c6a-bb34-3fde77594107`::Granted request >Thread-38::DEBUG::2012-11-29 11:09:28,738::task::817::TaskManager.Task::(resourceAcquired) Task=`9d2416ce-657c-40e7-a7fb-cb94c099628a`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-38::DEBUG::2012-11-29 11:09:28,738::task::978::TaskManager.Task::(_decref) Task=`9d2416ce-657c-40e7-a7fb-cb94c099628a`::ref 1 aborting False >Thread-38::INFO::2012-11-29 11:09:28,739::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '862429642752', 'disktotal': '862429642752', 'mdafree': 0}} >Thread-38::DEBUG::2012-11-29 11:09:28,739::task::1172::TaskManager.Task::(prepare) Task=`9d2416ce-657c-40e7-a7fb-cb94c099628a`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '862429642752', 'disktotal': '862429642752', 'mdafree': 0}} >Thread-38::DEBUG::2012-11-29 11:09:28,740::task::588::TaskManager.Task::(_updateState) Task=`9d2416ce-657c-40e7-a7fb-cb94c099628a`::moving from state preparing -> state finished >Thread-38::DEBUG::2012-11-29 11:09:28,740::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2012-11-29 11:09:28,740::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2012-11-29 11:09:28,741::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-38::DEBUG::2012-11-29 11:09:28,741::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-38::DEBUG::2012-11-29 11:09:28,741::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2012-11-29 11:09:28,742::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-38::DEBUG::2012-11-29 11:09:28,742::task::978::TaskManager.Task::(_decref) Task=`9d2416ce-657c-40e7-a7fb-cb94c099628a`::ref 0 aborting False >Thread-39::DEBUG::2012-11-29 11:09:30,054::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-39::DEBUG::2012-11-29 11:09:30,054::task::588::TaskManager.Task::(_updateState) Task=`50a066ef-12aa-442d-8ec9-1e074c001c81`::moving from state init -> state preparing >Thread-39::INFO::2012-11-29 11:09:30,055::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-39::INFO::2012-11-29 11:09:30,055::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-39::DEBUG::2012-11-29 11:09:30,055::task::1172::TaskManager.Task::(prepare) Task=`50a066ef-12aa-442d-8ec9-1e074c001c81`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-39::DEBUG::2012-11-29 11:09:30,056::task::588::TaskManager.Task::(_updateState) Task=`50a066ef-12aa-442d-8ec9-1e074c001c81`::moving from state preparing -> state finished >Thread-39::DEBUG::2012-11-29 11:09:30,056::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-39::DEBUG::2012-11-29 11:09:30,056::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-39::DEBUG::2012-11-29 11:09:30,056::task::978::TaskManager.Task::(_decref) Task=`50a066ef-12aa-442d-8ec9-1e074c001c81`::ref 0 aborting False >Thread-40::DEBUG::2012-11-29 11:09:30,087::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-40::DEBUG::2012-11-29 11:09:30,088::task::588::TaskManager.Task::(_updateState) Task=`c93d5cc3-0432-4f7e-85c4-9072e6da83ac`::moving from state init -> state preparing >Thread-40::INFO::2012-11-29 11:09:30,088::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-40::INFO::2012-11-29 11:09:30,090::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-40::DEBUG::2012-11-29 11:09:30,090::task::1172::TaskManager.Task::(prepare) Task=`c93d5cc3-0432-4f7e-85c4-9072e6da83ac`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-40::DEBUG::2012-11-29 11:09:30,091::task::588::TaskManager.Task::(_updateState) Task=`c93d5cc3-0432-4f7e-85c4-9072e6da83ac`::moving from state preparing -> state finished >Thread-40::DEBUG::2012-11-29 11:09:30,091::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-40::DEBUG::2012-11-29 11:09:30,091::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2012-11-29 11:09:30,091::task::978::TaskManager.Task::(_decref) Task=`c93d5cc3-0432-4f7e-85c4-9072e6da83ac`::ref 0 aborting False >Thread-41::DEBUG::2012-11-29 11:09:30,121::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-41::DEBUG::2012-11-29 11:09:30,121::task::588::TaskManager.Task::(_updateState) Task=`432b0d79-9cd5-4cd4-8f96-e00fe8831961`::moving from state init -> state preparing >Thread-41::INFO::2012-11-29 11:09:30,122::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', poolName='DefaultRest', masterDom='f1008a0c-010a-45a0-b80c-f5e8514a76e7', domList=['f1008a0c-010a-45a0-b80c-f5e8514a76e7'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-41::INFO::2012-11-29 11:09:30,122::fileSD::255::Storage.StorageDomain::(validate) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-41::DEBUG::2012-11-29 11:09:30,124::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9781f821ebfcefba63d51b5523965278b6a4f7f2'] >Thread-41::DEBUG::2012-11-29 11:09:30,125::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`8730afa5-11a5-4b8e-b8b8-ab481bac5b25`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-41::DEBUG::2012-11-29 11:09:30,125::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-41::DEBUG::2012-11-29 11:09:30,125::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-41::DEBUG::2012-11-29 11:09:30,126::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`8730afa5-11a5-4b8e-b8b8-ab481bac5b25`::Granted request >Thread-41::DEBUG::2012-11-29 11:09:30,126::task::817::TaskManager.Task::(resourceAcquired) Task=`432b0d79-9cd5-4cd4-8f96-e00fe8831961`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (exclusive) >Thread-41::DEBUG::2012-11-29 11:09:30,126::task::978::TaskManager.Task::(_decref) Task=`432b0d79-9cd5-4cd4-8f96-e00fe8831961`::ref 1 aborting False >Thread-41::DEBUG::2012-11-29 11:09:30,127::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`02988bb8-4473-47de-940b-3f9ca70d1128`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-41::DEBUG::2012-11-29 11:09:30,127::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'exclusive' >Thread-41::DEBUG::2012-11-29 11:09:30,127::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'exclusive' (1 active user) >Thread-41::DEBUG::2012-11-29 11:09:30,128::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`02988bb8-4473-47de-940b-3f9ca70d1128`::Granted request >Thread-41::DEBUG::2012-11-29 11:09:30,128::task::817::TaskManager.Task::(resourceAcquired) Task=`432b0d79-9cd5-4cd4-8f96-e00fe8831961`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (exclusive) >Thread-41::DEBUG::2012-11-29 11:09:30,128::task::978::TaskManager.Task::(_decref) Task=`432b0d79-9cd5-4cd4-8f96-e00fe8831961`::ref 1 aborting False >Thread-41::INFO::2012-11-29 11:09:30,129::sp::548::Storage.StoragePool::(create) spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 poolName=DefaultRest master_sd=f1008a0c-010a-45a0-b80c-f5e8514a76e7 domList=['f1008a0c-010a-45a0-b80c-f5e8514a76e7'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-41::INFO::2012-11-29 11:09:30,129::fileSD::255::Storage.StorageDomain::(validate) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-41::DEBUG::2012-11-29 11:09:30,131::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9781f821ebfcefba63d51b5523965278b6a4f7f2'] >Thread-41::DEBUG::2012-11-29 11:09:30,133::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9781f821ebfcefba63d51b5523965278b6a4f7f2'] >Thread-41::DEBUG::2012-11-29 11:09:30,133::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >Thread-41::DEBUG::2012-11-29 11:09:30,134::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >Thread-41::DEBUG::2012-11-29 11:09:30,134::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6ebd15790bcb35bb25657b68486e0d1faf314026'] >Thread-41::DEBUG::2012-11-29 11:09:30,137::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >Thread-41::INFO::2012-11-29 11:09:30,138::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 250) >Thread-45::DEBUG::2012-11-29 11:09:36,347::task::588::TaskManager.Task::(_updateState) Task=`db0c9811-f97c-4f23-a2d1-08699fa05607`::moving from state init -> state preparing >Thread-45::INFO::2012-11-29 11:09:36,347::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-45::INFO::2012-11-29 11:09:36,348::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-45::DEBUG::2012-11-29 11:09:36,348::task::1172::TaskManager.Task::(prepare) Task=`db0c9811-f97c-4f23-a2d1-08699fa05607`::finished: {} >Thread-45::DEBUG::2012-11-29 11:09:36,348::task::588::TaskManager.Task::(_updateState) Task=`db0c9811-f97c-4f23-a2d1-08699fa05607`::moving from state preparing -> state finished >Thread-45::DEBUG::2012-11-29 11:09:36,349::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-45::DEBUG::2012-11-29 11:09:36,349::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-45::DEBUG::2012-11-29 11:09:36,349::task::978::TaskManager.Task::(_decref) Task=`db0c9811-f97c-4f23-a2d1-08699fa05607`::ref 0 aborting False >Thread-51::DEBUG::2012-11-29 11:09:46,631::task::588::TaskManager.Task::(_updateState) Task=`dbce2eb6-c48f-4cee-b763-11db3d7daebc`::moving from state init -> state preparing >Thread-51::INFO::2012-11-29 11:09:46,631::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-51::INFO::2012-11-29 11:09:46,632::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-51::DEBUG::2012-11-29 11:09:46,632::task::1172::TaskManager.Task::(prepare) Task=`dbce2eb6-c48f-4cee-b763-11db3d7daebc`::finished: {} >Thread-51::DEBUG::2012-11-29 11:09:46,632::task::588::TaskManager.Task::(_updateState) Task=`dbce2eb6-c48f-4cee-b763-11db3d7daebc`::moving from state preparing -> state finished >Thread-51::DEBUG::2012-11-29 11:09:46,632::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2012-11-29 11:09:46,633::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2012-11-29 11:09:46,633::task::978::TaskManager.Task::(_decref) Task=`dbce2eb6-c48f-4cee-b763-11db3d7daebc`::ref 0 aborting False >Thread-41::DEBUG::2012-11-29 11:09:51,144::safelease::178::SANLock::(acquireHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully acquired (id: 250) >Thread-41::INFO::2012-11-29 11:09:51,145::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 250) >Thread-41::DEBUG::2012-11-29 11:09:51,180::safelease::235::SANLock::(acquire) Cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully acquired (id: 250) >Thread-41::INFO::2012-11-29 11:09:51,181::sp::712::Storage.StoragePool::(createMaster) setting master domain for spUUID 21ea8081-3262-478a-8e4a-8e46b0e2fbc9 on sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-41::DEBUG::2012-11-29 11:09:51,181::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >Thread-41::DEBUG::2012-11-29 11:09:51,181::persistentDict::155::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-41::DEBUG::2012-11-29 11:09:51,185::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=6ebd15790bcb35bb25657b68486e0d1faf314026'] >Thread-41::DEBUG::2012-11-29 11:09:51,185::persistentDict::155::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-41::DEBUG::2012-11-29 11:09:51,185::persistentDict::155::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-41::DEBUG::2012-11-29 11:09:51,186::persistentDict::155::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-41::DEBUG::2012-11-29 11:09:51,186::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >Thread-41::DEBUG::2012-11-29 11:09:51,186::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=63c5dd33e910cffbaa66d83b1d3b903c802a143c'] >Thread-41::DEBUG::2012-11-29 11:09:51,189::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >Thread-41::DEBUG::2012-11-29 11:09:51,190::sp::1539::Storage.StoragePool::(getMasterDomain) Master domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 verified, version 1 >Thread-41::DEBUG::2012-11-29 11:09:51,190::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-41::DEBUG::2012-11-29 11:09:51,190::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-41::DEBUG::2012-11-29 11:09:51,193::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=63c5dd33e910cffbaa66d83b1d3b903c802a143c'] >Thread-55::DEBUG::2012-11-29 11:09:51,193::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-41::DEBUG::2012-11-29 11:09:51,193::sp::1573::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `21ea8081-3262-478a-8e4a-8e46b0e2fbc9` started monitoring domain `f1008a0c-010a-45a0-b80c-f5e8514a76e7` >Thread-41::DEBUG::2012-11-29 11:09:51,194::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-41::WARNING::2012-11-29 11:09:51,195::fileUtils::181::fileUtils::(createdir) Dir /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9 already exists >Thread-41::DEBUG::2012-11-29 11:09:51,196::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-41::DEBUG::2012-11-29 11:09:51,197::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-41::DEBUG::2012-11-29 11:09:51,320::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-41::DEBUG::2012-11-29 11:09:51,320::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-41::INFO::2012-11-29 11:09:51,325::sp::1133::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 to /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-41::INFO::2012-11-29 11:09:51,325::sp::1133::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 to /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd >Thread-41::INFO::2012-11-29 11:09:51,326::safelease::239::SANLock::(release) Releasing cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-41::DEBUG::2012-11-29 11:09:51,327::safelease::250::SANLock::(release) Cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully released >Thread-41::INFO::2012-11-29 11:09:51,328::safelease::183::SANLock::(releaseHostId) Releasing host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 250) >Thread-41::DEBUG::2012-11-29 11:09:53,329::safelease::193::SANLock::(releaseHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 released successfully (id: 250) >Thread-55::DEBUG::2012-11-29 11:09:53,329::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-55::INFO::2012-11-29 11:09:53,329::safelease::183::SANLock::(releaseHostId) Releasing host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 250) >Thread-55::DEBUG::2012-11-29 11:09:53,330::safelease::193::SANLock::(releaseHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 released successfully (id: 250) >Thread-41::INFO::2012-11-29 11:09:53,331::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-41::DEBUG::2012-11-29 11:09:53,331::task::1172::TaskManager.Task::(prepare) Task=`432b0d79-9cd5-4cd4-8f96-e00fe8831961`::finished: True >Thread-41::DEBUG::2012-11-29 11:09:53,331::task::588::TaskManager.Task::(_updateState) Task=`432b0d79-9cd5-4cd4-8f96-e00fe8831961`::moving from state preparing -> state finished >Thread-41::DEBUG::2012-11-29 11:09:53,332::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>, 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-41::DEBUG::2012-11-29 11:09:53,332::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-41::DEBUG::2012-11-29 11:09:53,332::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-41::DEBUG::2012-11-29 11:09:53,333::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-41::DEBUG::2012-11-29 11:09:53,333::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-41::DEBUG::2012-11-29 11:09:53,333::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-41::DEBUG::2012-11-29 11:09:53,334::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-41::DEBUG::2012-11-29 11:09:53,334::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-41::DEBUG::2012-11-29 11:09:53,334::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-41::DEBUG::2012-11-29 11:09:53,335::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-41::DEBUG::2012-11-29 11:09:53,335::task::978::TaskManager.Task::(_decref) Task=`432b0d79-9cd5-4cd4-8f96-e00fe8831961`::ref 0 aborting False >Thread-62::DEBUG::2012-11-29 11:09:53,433::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-62::DEBUG::2012-11-29 11:09:53,434::task::588::TaskManager.Task::(_updateState) Task=`306c046b-d389-4e9a-a6b1-44f59e50b308`::moving from state init -> state preparing >Thread-62::INFO::2012-11-29 11:09:53,434::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-62::INFO::2012-11-29 11:09:53,434::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-62::DEBUG::2012-11-29 11:09:53,435::task::1172::TaskManager.Task::(prepare) Task=`306c046b-d389-4e9a-a6b1-44f59e50b308`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-62::DEBUG::2012-11-29 11:09:53,435::task::588::TaskManager.Task::(_updateState) Task=`306c046b-d389-4e9a-a6b1-44f59e50b308`::moving from state preparing -> state finished >Thread-62::DEBUG::2012-11-29 11:09:53,435::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-62::DEBUG::2012-11-29 11:09:53,435::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::DEBUG::2012-11-29 11:09:53,436::task::978::TaskManager.Task::(_decref) Task=`306c046b-d389-4e9a-a6b1-44f59e50b308`::ref 0 aborting False >Thread-63::DEBUG::2012-11-29 11:09:53,471::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-63::DEBUG::2012-11-29 11:09:53,471::task::588::TaskManager.Task::(_updateState) Task=`0de54690-9225-4f81-90f6-77d3ae876d73`::moving from state init -> state preparing >Thread-63::INFO::2012-11-29 11:09:53,472::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-63::INFO::2012-11-29 11:09:53,474::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-63::DEBUG::2012-11-29 11:09:53,474::task::1172::TaskManager.Task::(prepare) Task=`0de54690-9225-4f81-90f6-77d3ae876d73`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-63::DEBUG::2012-11-29 11:09:53,474::task::588::TaskManager.Task::(_updateState) Task=`0de54690-9225-4f81-90f6-77d3ae876d73`::moving from state preparing -> state finished >Thread-63::DEBUG::2012-11-29 11:09:53,475::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-63::DEBUG::2012-11-29 11:09:53,475::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-63::DEBUG::2012-11-29 11:09:53,475::task::978::TaskManager.Task::(_decref) Task=`0de54690-9225-4f81-90f6-77d3ae876d73`::ref 0 aborting False >Thread-64::DEBUG::2012-11-29 11:09:53,564::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-64::DEBUG::2012-11-29 11:09:53,564::task::588::TaskManager.Task::(_updateState) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::moving from state init -> state preparing >Thread-64::INFO::2012-11-29 11:09:53,565::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-64::ERROR::2012-11-29 11:09:53,565::task::853::TaskManager.Task::(_setError) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 861, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 573, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 301, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('21ea8081-3262-478a-8e4a-8e46b0e2fbc9',) >Thread-64::DEBUG::2012-11-29 11:09:53,589::task::872::TaskManager.Task::(_run) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::Task._run: 63da8b86-57d9-4e9c-8ee6-cf434360c8eb ('21ea8081-3262-478a-8e4a-8e46b0e2fbc9',) {} failed - stopping task >Thread-64::DEBUG::2012-11-29 11:09:53,589::task::1199::TaskManager.Task::(stop) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::stopping in state preparing (force False) >Thread-64::DEBUG::2012-11-29 11:09:53,589::task::978::TaskManager.Task::(_decref) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::ref 1 aborting True >Thread-64::INFO::2012-11-29 11:09:53,590::task::1157::TaskManager.Task::(prepare) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-64::DEBUG::2012-11-29 11:09:53,590::task::1162::TaskManager.Task::(prepare) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::Prepare: aborted: Unknown pool id, pool not connected >Thread-64::DEBUG::2012-11-29 11:09:53,590::task::978::TaskManager.Task::(_decref) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::ref 0 aborting True >Thread-64::DEBUG::2012-11-29 11:09:53,591::task::913::TaskManager.Task::(_doAbort) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::Task._doAbort: force False >Thread-64::DEBUG::2012-11-29 11:09:53,591::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2012-11-29 11:09:53,591::task::588::TaskManager.Task::(_updateState) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::moving from state preparing -> state aborting >Thread-64::DEBUG::2012-11-29 11:09:53,591::task::537::TaskManager.Task::(__state_aborting) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::_aborting: recover policy none >Thread-64::DEBUG::2012-11-29 11:09:53,592::task::588::TaskManager.Task::(_updateState) Task=`63da8b86-57d9-4e9c-8ee6-cf434360c8eb`::moving from state aborting -> state failed >Thread-64::DEBUG::2012-11-29 11:09:53,592::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2012-11-29 11:09:53,592::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::ERROR::2012-11-29 11:09:53,593::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('21ea8081-3262-478a-8e4a-8e46b0e2fbc9',)", 'code': 309}} >Thread-65::DEBUG::2012-11-29 11:09:53,633::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-65::DEBUG::2012-11-29 11:09:53,634::task::588::TaskManager.Task::(_updateState) Task=`4be29b9f-70d6-4af3-9317-b26533ca28f6`::moving from state init -> state preparing >Thread-65::INFO::2012-11-29 11:09:53,634::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', hostID=1, scsiKey='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', msdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', masterVersion=1, options=None) >Thread-65::DEBUG::2012-11-29 11:09:53,635::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`7dfa44cc-4bf5-4cf6-b62f-46e0bead8d7f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-65::DEBUG::2012-11-29 11:09:53,635::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-65::DEBUG::2012-11-29 11:09:53,635::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-65::DEBUG::2012-11-29 11:09:53,636::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`7dfa44cc-4bf5-4cf6-b62f-46e0bead8d7f`::Granted request >Thread-65::INFO::2012-11-29 11:09:53,636::sp::632::Storage.StoragePool::(connect) Connect host #1 to the storage pool 21ea8081-3262-478a-8e4a-8e46b0e2fbc9 with master domain: f1008a0c-010a-45a0-b80c-f5e8514a76e7 (ver = 1) >Thread-65::DEBUG::2012-11-29 11:09:53,637::sp::1539::Storage.StoragePool::(getMasterDomain) Master domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 verified, version 1 >Thread-65::DEBUG::2012-11-29 11:09:53,637::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-65::DEBUG::2012-11-29 11:09:53,637::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-65::DEBUG::2012-11-29 11:09:53,639::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=63c5dd33e910cffbaa66d83b1d3b903c802a143c'] >Thread-66::DEBUG::2012-11-29 11:09:53,640::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-65::DEBUG::2012-11-29 11:09:53,640::sp::1573::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `21ea8081-3262-478a-8e4a-8e46b0e2fbc9` started monitoring domain `f1008a0c-010a-45a0-b80c-f5e8514a76e7` >Thread-65::DEBUG::2012-11-29 11:09:53,641::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-65::WARNING::2012-11-29 11:09:53,642::fileUtils::181::fileUtils::(createdir) Dir /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9 already exists >Thread-65::DEBUG::2012-11-29 11:09:53,643::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-65::DEBUG::2012-11-29 11:09:53,644::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-66::INFO::2012-11-29 11:09:53,650::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 1) >Thread-66::DEBUG::2012-11-29 11:09:53,651::safelease::178::SANLock::(acquireHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully acquired (id: 1) >Thread-65::DEBUG::2012-11-29 11:09:53,766::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-65::DEBUG::2012-11-29 11:09:53,766::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-65::INFO::2012-11-29 11:09:53,770::sp::1133::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 to /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-65::INFO::2012-11-29 11:09:53,771::sp::1133::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 to /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd >Thread-65::DEBUG::2012-11-29 11:09:53,771::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-65::DEBUG::2012-11-29 11:09:53,772::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-65::DEBUG::2012-11-29 11:09:53,772::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-65::DEBUG::2012-11-29 11:09:53,772::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-65::INFO::2012-11-29 11:09:53,773::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-65::DEBUG::2012-11-29 11:09:53,773::task::1172::TaskManager.Task::(prepare) Task=`4be29b9f-70d6-4af3-9317-b26533ca28f6`::finished: True >Thread-65::DEBUG::2012-11-29 11:09:53,773::task::588::TaskManager.Task::(_updateState) Task=`4be29b9f-70d6-4af3-9317-b26533ca28f6`::moving from state preparing -> state finished >Thread-65::DEBUG::2012-11-29 11:09:53,773::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-65::DEBUG::2012-11-29 11:09:53,774::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-65::DEBUG::2012-11-29 11:09:53,774::task::978::TaskManager.Task::(_decref) Task=`4be29b9f-70d6-4af3-9317-b26533ca28f6`::ref 0 aborting False >Thread-72::DEBUG::2012-11-29 11:09:53,813::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-72::DEBUG::2012-11-29 11:09:53,814::task::588::TaskManager.Task::(_updateState) Task=`c1a69a77-3115-4cf8-adbf-6e740cea5ad5`::moving from state init -> state preparing >Thread-72::INFO::2012-11-29 11:09:53,814::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-72::INFO::2012-11-29 11:09:53,815::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-72::DEBUG::2012-11-29 11:09:53,815::task::1172::TaskManager.Task::(prepare) Task=`c1a69a77-3115-4cf8-adbf-6e740cea5ad5`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-72::DEBUG::2012-11-29 11:09:53,815::task::588::TaskManager.Task::(_updateState) Task=`c1a69a77-3115-4cf8-adbf-6e740cea5ad5`::moving from state preparing -> state finished >Thread-72::DEBUG::2012-11-29 11:09:53,815::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-72::DEBUG::2012-11-29 11:09:53,816::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-72::DEBUG::2012-11-29 11:09:53,816::task::978::TaskManager.Task::(_decref) Task=`c1a69a77-3115-4cf8-adbf-6e740cea5ad5`::ref 0 aborting False >Thread-73::DEBUG::2012-11-29 11:09:53,864::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-73::DEBUG::2012-11-29 11:09:53,865::task::588::TaskManager.Task::(_updateState) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::moving from state init -> state preparing >Thread-73::INFO::2012-11-29 11:09:53,865::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-73::DEBUG::2012-11-29 11:09:53,866::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`b9db1ce8-3a4f-4e61-a2e2-f5e22967e8aa`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-73::DEBUG::2012-11-29 11:09:53,866::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-73::DEBUG::2012-11-29 11:09:53,866::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-73::DEBUG::2012-11-29 11:09:53,867::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`b9db1ce8-3a4f-4e61-a2e2-f5e22967e8aa`::Granted request >Thread-73::DEBUG::2012-11-29 11:09:53,867::task::817::TaskManager.Task::(resourceAcquired) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (exclusive) >Thread-73::DEBUG::2012-11-29 11:09:53,867::task::978::TaskManager.Task::(_decref) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::ref 1 aborting False >Thread-73::INFO::2012-11-29 11:09:53,868::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-73::DEBUG::2012-11-29 11:09:53,868::task::1167::TaskManager.Task::(prepare) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::Prepare: 1 jobs exist, move to acquiring >Thread-73::DEBUG::2012-11-29 11:09:53,868::task::588::TaskManager.Task::(_updateState) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::moving from state preparing -> state acquiring >Thread-73::DEBUG::2012-11-29 11:09:53,869::task::588::TaskManager.Task::(_updateState) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::moving from state acquiring -> state queued >Thread-73::DEBUG::2012-11-29 11:09:53,869::taskManager::48::TaskManager::(_queueTask) queueing task: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-73::DEBUG::2012-11-29 11:09:53,869::taskManager::54::TaskManager::(_queueTask) task queued: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-6::DEBUG::2012-11-29 11:09:53,869::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-73::DEBUG::2012-11-29 11:09:53,870::task::1169::TaskManager.Task::(prepare) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::returning >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,870::threadPool::212::Misc.ThreadPool.WorkerThread::(run) Task: 1b869ebe-5376-42e5-a995-cb0cc15b9ada running: <bound method Task.commit of <storage.task.Task instance at 0x1361c20>> with: None >Thread-73::DEBUG::2012-11-29 11:09:53,870::task::978::TaskManager.Task::(_decref) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::ref 0 aborting False >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,871::task::1181::TaskManager.Task::(commit) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::Commiting task: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,871::task::588::TaskManager.Task::(_updateState) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::moving from state queued -> state running >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,872::task::892::TaskManager.Task::(_runJobs) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x12ada90>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,872::task::317::TaskManager.Task::(run) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x12ada90>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,872::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,873::misc::1046::SamplingMethod::(__call__) Got in to sampling method >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,875::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=63c5dd33e910cffbaa66d83b1d3b903c802a143c'] >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,875::misc::1054::SamplingMethod::(__call__) Returning last result >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:09:53,877::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=63c5dd33e910cffbaa66d83b1d3b903c802a143c'] >1b869ebe-5376-42e5-a995-cb0cc15b9ada::INFO::2012-11-29 11:09:53,877::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 1) >Thread-75::DEBUG::2012-11-29 11:09:54,905::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-75::DEBUG::2012-11-29 11:09:54,905::task::588::TaskManager.Task::(_updateState) Task=`c8a57a05-c953-47ee-bfc5-87e35e66b4b7`::moving from state init -> state preparing >Thread-75::INFO::2012-11-29 11:09:54,906::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-75::DEBUG::2012-11-29 11:09:54,906::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-75::DEBUG::2012-11-29 11:09:54,906::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-75::INFO::2012-11-29 11:09:54,907::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-75::DEBUG::2012-11-29 11:09:54,907::task::1172::TaskManager.Task::(prepare) Task=`c8a57a05-c953-47ee-bfc5-87e35e66b4b7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-75::DEBUG::2012-11-29 11:09:54,907::task::588::TaskManager.Task::(_updateState) Task=`c8a57a05-c953-47ee-bfc5-87e35e66b4b7`::moving from state preparing -> state finished >Thread-75::DEBUG::2012-11-29 11:09:54,907::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-75::DEBUG::2012-11-29 11:09:54,908::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-75::DEBUG::2012-11-29 11:09:54,908::task::978::TaskManager.Task::(_decref) Task=`c8a57a05-c953-47ee-bfc5-87e35e66b4b7`::ref 0 aborting False >Thread-76::DEBUG::2012-11-29 11:09:55,941::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-76::DEBUG::2012-11-29 11:09:55,941::task::588::TaskManager.Task::(_updateState) Task=`c9d4a86a-4986-41e0-8c13-e675fc60dcb6`::moving from state init -> state preparing >Thread-76::INFO::2012-11-29 11:09:55,942::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-76::DEBUG::2012-11-29 11:09:55,942::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-76::DEBUG::2012-11-29 11:09:55,942::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-76::INFO::2012-11-29 11:09:55,942::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-76::DEBUG::2012-11-29 11:09:55,943::task::1172::TaskManager.Task::(prepare) Task=`c9d4a86a-4986-41e0-8c13-e675fc60dcb6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-76::DEBUG::2012-11-29 11:09:55,943::task::588::TaskManager.Task::(_updateState) Task=`c9d4a86a-4986-41e0-8c13-e675fc60dcb6`::moving from state preparing -> state finished >Thread-76::DEBUG::2012-11-29 11:09:55,943::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2012-11-29 11:09:55,944::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2012-11-29 11:09:55,944::task::978::TaskManager.Task::(_decref) Task=`c9d4a86a-4986-41e0-8c13-e675fc60dcb6`::ref 0 aborting False >Thread-77::DEBUG::2012-11-29 11:09:56,867::task::588::TaskManager.Task::(_updateState) Task=`b51e689d-422f-4fd2-be5d-5f95d4bf889f`::moving from state init -> state preparing >Thread-77::INFO::2012-11-29 11:09:56,868::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-77::INFO::2012-11-29 11:09:56,868::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00123000144958', 'lastCheck': '3.2', 'code': 0, 'valid': True}} >Thread-77::DEBUG::2012-11-29 11:09:56,868::task::1172::TaskManager.Task::(prepare) Task=`b51e689d-422f-4fd2-be5d-5f95d4bf889f`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00123000144958', 'lastCheck': '3.2', 'code': 0, 'valid': True}} >Thread-77::DEBUG::2012-11-29 11:09:56,869::task::588::TaskManager.Task::(_updateState) Task=`b51e689d-422f-4fd2-be5d-5f95d4bf889f`::moving from state preparing -> state finished >Thread-77::DEBUG::2012-11-29 11:09:56,869::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-77::DEBUG::2012-11-29 11:09:56,869::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-77::DEBUG::2012-11-29 11:09:56,869::task::978::TaskManager.Task::(_decref) Task=`b51e689d-422f-4fd2-be5d-5f95d4bf889f`::ref 0 aborting False >Thread-79::DEBUG::2012-11-29 11:09:56,975::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-79::DEBUG::2012-11-29 11:09:56,976::task::588::TaskManager.Task::(_updateState) Task=`97cc9dc4-7032-4c0b-8261-5cbeb2cba268`::moving from state init -> state preparing >Thread-79::INFO::2012-11-29 11:09:56,976::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-79::DEBUG::2012-11-29 11:09:56,977::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-79::DEBUG::2012-11-29 11:09:56,977::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-79::INFO::2012-11-29 11:09:56,977::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-79::DEBUG::2012-11-29 11:09:56,977::task::1172::TaskManager.Task::(prepare) Task=`97cc9dc4-7032-4c0b-8261-5cbeb2cba268`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-79::DEBUG::2012-11-29 11:09:56,978::task::588::TaskManager.Task::(_updateState) Task=`97cc9dc4-7032-4c0b-8261-5cbeb2cba268`::moving from state preparing -> state finished >Thread-79::DEBUG::2012-11-29 11:09:56,978::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-79::DEBUG::2012-11-29 11:09:56,978::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-79::DEBUG::2012-11-29 11:09:56,979::task::978::TaskManager.Task::(_decref) Task=`97cc9dc4-7032-4c0b-8261-5cbeb2cba268`::ref 0 aborting False >Thread-80::DEBUG::2012-11-29 11:09:58,019::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-80::DEBUG::2012-11-29 11:09:58,019::task::588::TaskManager.Task::(_updateState) Task=`9dcd82ef-7cad-4f10-8199-f02f039678de`::moving from state init -> state preparing >Thread-80::INFO::2012-11-29 11:09:58,020::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-80::DEBUG::2012-11-29 11:09:58,020::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-80::DEBUG::2012-11-29 11:09:58,021::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-80::INFO::2012-11-29 11:09:58,021::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-80::DEBUG::2012-11-29 11:09:58,021::task::1172::TaskManager.Task::(prepare) Task=`9dcd82ef-7cad-4f10-8199-f02f039678de`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-80::DEBUG::2012-11-29 11:09:58,021::task::588::TaskManager.Task::(_updateState) Task=`9dcd82ef-7cad-4f10-8199-f02f039678de`::moving from state preparing -> state finished >Thread-80::DEBUG::2012-11-29 11:09:58,022::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-80::DEBUG::2012-11-29 11:09:58,022::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-80::DEBUG::2012-11-29 11:09:58,022::task::978::TaskManager.Task::(_decref) Task=`9dcd82ef-7cad-4f10-8199-f02f039678de`::ref 0 aborting False >Thread-82::DEBUG::2012-11-29 11:09:59,054::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-82::DEBUG::2012-11-29 11:09:59,055::task::588::TaskManager.Task::(_updateState) Task=`31c54ef4-3030-4d03-ae39-95d957c48312`::moving from state init -> state preparing >Thread-82::INFO::2012-11-29 11:09:59,055::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-82::DEBUG::2012-11-29 11:09:59,055::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-82::DEBUG::2012-11-29 11:09:59,056::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-82::INFO::2012-11-29 11:09:59,056::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-82::DEBUG::2012-11-29 11:09:59,056::task::1172::TaskManager.Task::(prepare) Task=`31c54ef4-3030-4d03-ae39-95d957c48312`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-82::DEBUG::2012-11-29 11:09:59,057::task::588::TaskManager.Task::(_updateState) Task=`31c54ef4-3030-4d03-ae39-95d957c48312`::moving from state preparing -> state finished >Thread-82::DEBUG::2012-11-29 11:09:59,057::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-82::DEBUG::2012-11-29 11:09:59,057::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-82::DEBUG::2012-11-29 11:09:59,057::task::978::TaskManager.Task::(_decref) Task=`31c54ef4-3030-4d03-ae39-95d957c48312`::ref 0 aborting False >Thread-83::DEBUG::2012-11-29 11:10:00,086::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-83::DEBUG::2012-11-29 11:10:00,086::task::588::TaskManager.Task::(_updateState) Task=`5dcb44cb-58b9-4edb-9060-8e3c0fede1d6`::moving from state init -> state preparing >Thread-83::INFO::2012-11-29 11:10:00,087::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-83::DEBUG::2012-11-29 11:10:00,087::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-83::DEBUG::2012-11-29 11:10:00,087::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-83::INFO::2012-11-29 11:10:00,088::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-83::DEBUG::2012-11-29 11:10:00,088::task::1172::TaskManager.Task::(prepare) Task=`5dcb44cb-58b9-4edb-9060-8e3c0fede1d6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-83::DEBUG::2012-11-29 11:10:00,088::task::588::TaskManager.Task::(_updateState) Task=`5dcb44cb-58b9-4edb-9060-8e3c0fede1d6`::moving from state preparing -> state finished >Thread-83::DEBUG::2012-11-29 11:10:00,088::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-83::DEBUG::2012-11-29 11:10:00,089::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-83::DEBUG::2012-11-29 11:10:00,089::task::978::TaskManager.Task::(_decref) Task=`5dcb44cb-58b9-4edb-9060-8e3c0fede1d6`::ref 0 aborting False >Thread-85::DEBUG::2012-11-29 11:10:01,120::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-85::DEBUG::2012-11-29 11:10:01,120::task::588::TaskManager.Task::(_updateState) Task=`a10e61d8-df26-4ae1-b1ab-b14ec44469c8`::moving from state init -> state preparing >Thread-85::INFO::2012-11-29 11:10:01,121::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-85::DEBUG::2012-11-29 11:10:01,121::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-85::DEBUG::2012-11-29 11:10:01,121::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-85::INFO::2012-11-29 11:10:01,122::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-85::DEBUG::2012-11-29 11:10:01,122::task::1172::TaskManager.Task::(prepare) Task=`a10e61d8-df26-4ae1-b1ab-b14ec44469c8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-85::DEBUG::2012-11-29 11:10:01,122::task::588::TaskManager.Task::(_updateState) Task=`a10e61d8-df26-4ae1-b1ab-b14ec44469c8`::moving from state preparing -> state finished >Thread-85::DEBUG::2012-11-29 11:10:01,122::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-85::DEBUG::2012-11-29 11:10:01,123::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-85::DEBUG::2012-11-29 11:10:01,123::task::978::TaskManager.Task::(_decref) Task=`a10e61d8-df26-4ae1-b1ab-b14ec44469c8`::ref 0 aborting False >Thread-86::DEBUG::2012-11-29 11:10:02,169::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-86::DEBUG::2012-11-29 11:10:02,174::task::588::TaskManager.Task::(_updateState) Task=`dd065684-8749-4ae6-b3c1-bca26a5d0dd0`::moving from state init -> state preparing >Thread-86::INFO::2012-11-29 11:10:02,174::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-86::DEBUG::2012-11-29 11:10:02,175::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-86::DEBUG::2012-11-29 11:10:02,175::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-86::INFO::2012-11-29 11:10:02,175::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-86::DEBUG::2012-11-29 11:10:02,176::task::1172::TaskManager.Task::(prepare) Task=`dd065684-8749-4ae6-b3c1-bca26a5d0dd0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-86::DEBUG::2012-11-29 11:10:02,176::task::588::TaskManager.Task::(_updateState) Task=`dd065684-8749-4ae6-b3c1-bca26a5d0dd0`::moving from state preparing -> state finished >Thread-86::DEBUG::2012-11-29 11:10:02,176::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-86::DEBUG::2012-11-29 11:10:02,176::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-86::DEBUG::2012-11-29 11:10:02,177::task::978::TaskManager.Task::(_decref) Task=`dd065684-8749-4ae6-b3c1-bca26a5d0dd0`::ref 0 aborting False >Thread-88::DEBUG::2012-11-29 11:10:03,212::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-88::DEBUG::2012-11-29 11:10:03,212::task::588::TaskManager.Task::(_updateState) Task=`d266ffd2-34e6-41da-ab70-2391bee3185d`::moving from state init -> state preparing >Thread-88::INFO::2012-11-29 11:10:03,213::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-88::DEBUG::2012-11-29 11:10:03,213::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-88::DEBUG::2012-11-29 11:10:03,213::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-88::INFO::2012-11-29 11:10:03,214::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-88::DEBUG::2012-11-29 11:10:03,214::task::1172::TaskManager.Task::(prepare) Task=`d266ffd2-34e6-41da-ab70-2391bee3185d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-88::DEBUG::2012-11-29 11:10:03,214::task::588::TaskManager.Task::(_updateState) Task=`d266ffd2-34e6-41da-ab70-2391bee3185d`::moving from state preparing -> state finished >Thread-88::DEBUG::2012-11-29 11:10:03,214::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-88::DEBUG::2012-11-29 11:10:03,215::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-88::DEBUG::2012-11-29 11:10:03,215::task::978::TaskManager.Task::(_decref) Task=`d266ffd2-34e6-41da-ab70-2391bee3185d`::ref 0 aborting False >Thread-89::DEBUG::2012-11-29 11:10:04,254::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-89::DEBUG::2012-11-29 11:10:04,254::task::588::TaskManager.Task::(_updateState) Task=`aeeb2c0c-7b83-427f-9b56-03114c203244`::moving from state init -> state preparing >Thread-89::INFO::2012-11-29 11:10:04,255::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-89::DEBUG::2012-11-29 11:10:04,255::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-89::DEBUG::2012-11-29 11:10:04,255::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-89::INFO::2012-11-29 11:10:04,256::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-89::DEBUG::2012-11-29 11:10:04,256::task::1172::TaskManager.Task::(prepare) Task=`aeeb2c0c-7b83-427f-9b56-03114c203244`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-89::DEBUG::2012-11-29 11:10:04,256::task::588::TaskManager.Task::(_updateState) Task=`aeeb2c0c-7b83-427f-9b56-03114c203244`::moving from state preparing -> state finished >Thread-89::DEBUG::2012-11-29 11:10:04,256::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-89::DEBUG::2012-11-29 11:10:04,257::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-89::DEBUG::2012-11-29 11:10:04,257::task::978::TaskManager.Task::(_decref) Task=`aeeb2c0c-7b83-427f-9b56-03114c203244`::ref 0 aborting False >Thread-91::DEBUG::2012-11-29 11:10:05,287::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-91::DEBUG::2012-11-29 11:10:05,288::task::588::TaskManager.Task::(_updateState) Task=`3258f52b-7e7e-4f83-acb7-271ae748746f`::moving from state init -> state preparing >Thread-91::INFO::2012-11-29 11:10:05,288::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-91::DEBUG::2012-11-29 11:10:05,288::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-91::DEBUG::2012-11-29 11:10:05,289::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-91::INFO::2012-11-29 11:10:05,289::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-91::DEBUG::2012-11-29 11:10:05,289::task::1172::TaskManager.Task::(prepare) Task=`3258f52b-7e7e-4f83-acb7-271ae748746f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-91::DEBUG::2012-11-29 11:10:05,289::task::588::TaskManager.Task::(_updateState) Task=`3258f52b-7e7e-4f83-acb7-271ae748746f`::moving from state preparing -> state finished >Thread-91::DEBUG::2012-11-29 11:10:05,290::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-91::DEBUG::2012-11-29 11:10:05,290::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2012-11-29 11:10:05,290::task::978::TaskManager.Task::(_decref) Task=`3258f52b-7e7e-4f83-acb7-271ae748746f`::ref 0 aborting False >Thread-92::DEBUG::2012-11-29 11:10:06,325::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-92::DEBUG::2012-11-29 11:10:06,326::task::588::TaskManager.Task::(_updateState) Task=`6b8949e3-66c1-49b8-b32f-31d272e541bd`::moving from state init -> state preparing >Thread-92::INFO::2012-11-29 11:10:06,326::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-92::DEBUG::2012-11-29 11:10:06,327::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-92::DEBUG::2012-11-29 11:10:06,327::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-92::INFO::2012-11-29 11:10:06,327::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-92::DEBUG::2012-11-29 11:10:06,327::task::1172::TaskManager.Task::(prepare) Task=`6b8949e3-66c1-49b8-b32f-31d272e541bd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-92::DEBUG::2012-11-29 11:10:06,328::task::588::TaskManager.Task::(_updateState) Task=`6b8949e3-66c1-49b8-b32f-31d272e541bd`::moving from state preparing -> state finished >Thread-92::DEBUG::2012-11-29 11:10:06,328::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-92::DEBUG::2012-11-29 11:10:06,328::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-92::DEBUG::2012-11-29 11:10:06,329::task::978::TaskManager.Task::(_decref) Task=`6b8949e3-66c1-49b8-b32f-31d272e541bd`::ref 0 aborting False >Thread-93::DEBUG::2012-11-29 11:10:07,147::task::588::TaskManager.Task::(_updateState) Task=`6a88bbb4-59e9-4eee-a27b-b7140eb30c60`::moving from state init -> state preparing >Thread-93::INFO::2012-11-29 11:10:07,148::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-93::INFO::2012-11-29 11:10:07,148::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00123000144958', 'lastCheck': '13.5', 'code': 0, 'valid': True}} >Thread-93::DEBUG::2012-11-29 11:10:07,148::task::1172::TaskManager.Task::(prepare) Task=`6a88bbb4-59e9-4eee-a27b-b7140eb30c60`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00123000144958', 'lastCheck': '13.5', 'code': 0, 'valid': True}} >Thread-93::DEBUG::2012-11-29 11:10:07,149::task::588::TaskManager.Task::(_updateState) Task=`6a88bbb4-59e9-4eee-a27b-b7140eb30c60`::moving from state preparing -> state finished >Thread-93::DEBUG::2012-11-29 11:10:07,149::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-93::DEBUG::2012-11-29 11:10:07,149::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-93::DEBUG::2012-11-29 11:10:07,150::task::978::TaskManager.Task::(_decref) Task=`6a88bbb4-59e9-4eee-a27b-b7140eb30c60`::ref 0 aborting False >Thread-95::DEBUG::2012-11-29 11:10:07,366::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-95::DEBUG::2012-11-29 11:10:07,367::task::588::TaskManager.Task::(_updateState) Task=`eeb42e83-83c2-4b11-a8ec-a1e1b03516e6`::moving from state init -> state preparing >Thread-95::INFO::2012-11-29 11:10:07,368::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-95::DEBUG::2012-11-29 11:10:07,374::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-95::DEBUG::2012-11-29 11:10:07,374::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-95::INFO::2012-11-29 11:10:07,375::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-95::DEBUG::2012-11-29 11:10:07,375::task::1172::TaskManager.Task::(prepare) Task=`eeb42e83-83c2-4b11-a8ec-a1e1b03516e6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-95::DEBUG::2012-11-29 11:10:07,375::task::588::TaskManager.Task::(_updateState) Task=`eeb42e83-83c2-4b11-a8ec-a1e1b03516e6`::moving from state preparing -> state finished >Thread-95::DEBUG::2012-11-29 11:10:07,376::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-95::DEBUG::2012-11-29 11:10:07,376::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-95::DEBUG::2012-11-29 11:10:07,376::task::978::TaskManager.Task::(_decref) Task=`eeb42e83-83c2-4b11-a8ec-a1e1b03516e6`::ref 0 aborting False >Thread-96::DEBUG::2012-11-29 11:10:08,426::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-96::DEBUG::2012-11-29 11:10:08,427::task::588::TaskManager.Task::(_updateState) Task=`29d2443c-8a9d-48a4-a4f7-a6e83d0c0da2`::moving from state init -> state preparing >Thread-96::INFO::2012-11-29 11:10:08,427::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-96::DEBUG::2012-11-29 11:10:08,428::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-96::DEBUG::2012-11-29 11:10:08,428::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-96::INFO::2012-11-29 11:10:08,429::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-96::DEBUG::2012-11-29 11:10:08,429::task::1172::TaskManager.Task::(prepare) Task=`29d2443c-8a9d-48a4-a4f7-a6e83d0c0da2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-96::DEBUG::2012-11-29 11:10:08,429::task::588::TaskManager.Task::(_updateState) Task=`29d2443c-8a9d-48a4-a4f7-a6e83d0c0da2`::moving from state preparing -> state finished >Thread-96::DEBUG::2012-11-29 11:10:08,430::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-96::DEBUG::2012-11-29 11:10:08,430::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-96::DEBUG::2012-11-29 11:10:08,431::task::978::TaskManager.Task::(_decref) Task=`29d2443c-8a9d-48a4-a4f7-a6e83d0c0da2`::ref 0 aborting False >Thread-98::DEBUG::2012-11-29 11:10:09,460::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-98::DEBUG::2012-11-29 11:10:09,461::task::588::TaskManager.Task::(_updateState) Task=`5b1f4c6e-8fa7-44b1-a014-004109f4f977`::moving from state init -> state preparing >Thread-98::INFO::2012-11-29 11:10:09,461::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-98::DEBUG::2012-11-29 11:10:09,462::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-98::DEBUG::2012-11-29 11:10:09,462::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-98::INFO::2012-11-29 11:10:09,462::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-98::DEBUG::2012-11-29 11:10:09,462::task::1172::TaskManager.Task::(prepare) Task=`5b1f4c6e-8fa7-44b1-a014-004109f4f977`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-98::DEBUG::2012-11-29 11:10:09,463::task::588::TaskManager.Task::(_updateState) Task=`5b1f4c6e-8fa7-44b1-a014-004109f4f977`::moving from state preparing -> state finished >Thread-98::DEBUG::2012-11-29 11:10:09,463::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-98::DEBUG::2012-11-29 11:10:09,463::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-98::DEBUG::2012-11-29 11:10:09,464::task::978::TaskManager.Task::(_decref) Task=`5b1f4c6e-8fa7-44b1-a014-004109f4f977`::ref 0 aborting False >Thread-99::DEBUG::2012-11-29 11:10:10,494::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-99::DEBUG::2012-11-29 11:10:10,495::task::588::TaskManager.Task::(_updateState) Task=`257141f7-5486-4717-a994-04d1a71c4089`::moving from state init -> state preparing >Thread-99::INFO::2012-11-29 11:10:10,495::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-99::DEBUG::2012-11-29 11:10:10,496::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-99::DEBUG::2012-11-29 11:10:10,496::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-99::INFO::2012-11-29 11:10:10,496::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-99::DEBUG::2012-11-29 11:10:10,497::task::1172::TaskManager.Task::(prepare) Task=`257141f7-5486-4717-a994-04d1a71c4089`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-99::DEBUG::2012-11-29 11:10:10,497::task::588::TaskManager.Task::(_updateState) Task=`257141f7-5486-4717-a994-04d1a71c4089`::moving from state preparing -> state finished >Thread-99::DEBUG::2012-11-29 11:10:10,498::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-99::DEBUG::2012-11-29 11:10:10,498::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-99::DEBUG::2012-11-29 11:10:10,498::task::978::TaskManager.Task::(_decref) Task=`257141f7-5486-4717-a994-04d1a71c4089`::ref 0 aborting False >Thread-101::DEBUG::2012-11-29 11:10:11,529::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-101::DEBUG::2012-11-29 11:10:11,530::task::588::TaskManager.Task::(_updateState) Task=`557b4666-d681-4bc7-b40a-d051fd1d4969`::moving from state init -> state preparing >Thread-101::INFO::2012-11-29 11:10:11,530::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-101::DEBUG::2012-11-29 11:10:11,530::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-101::DEBUG::2012-11-29 11:10:11,531::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-101::INFO::2012-11-29 11:10:11,531::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-101::DEBUG::2012-11-29 11:10:11,532::task::1172::TaskManager.Task::(prepare) Task=`557b4666-d681-4bc7-b40a-d051fd1d4969`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-101::DEBUG::2012-11-29 11:10:11,532::task::588::TaskManager.Task::(_updateState) Task=`557b4666-d681-4bc7-b40a-d051fd1d4969`::moving from state preparing -> state finished >Thread-101::DEBUG::2012-11-29 11:10:11,532::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-101::DEBUG::2012-11-29 11:10:11,533::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-101::DEBUG::2012-11-29 11:10:11,533::task::978::TaskManager.Task::(_decref) Task=`557b4666-d681-4bc7-b40a-d051fd1d4969`::ref 0 aborting False >Thread-102::DEBUG::2012-11-29 11:10:12,564::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-102::DEBUG::2012-11-29 11:10:12,565::task::588::TaskManager.Task::(_updateState) Task=`d98dee83-05a0-49fa-9448-5cb5a9485432`::moving from state init -> state preparing >Thread-102::INFO::2012-11-29 11:10:12,565::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-102::DEBUG::2012-11-29 11:10:12,566::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-102::DEBUG::2012-11-29 11:10:12,566::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-102::INFO::2012-11-29 11:10:12,566::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-102::DEBUG::2012-11-29 11:10:12,566::task::1172::TaskManager.Task::(prepare) Task=`d98dee83-05a0-49fa-9448-5cb5a9485432`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-102::DEBUG::2012-11-29 11:10:12,567::task::588::TaskManager.Task::(_updateState) Task=`d98dee83-05a0-49fa-9448-5cb5a9485432`::moving from state preparing -> state finished >Thread-102::DEBUG::2012-11-29 11:10:12,567::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2012-11-29 11:10:12,567::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2012-11-29 11:10:12,568::task::978::TaskManager.Task::(_decref) Task=`d98dee83-05a0-49fa-9448-5cb5a9485432`::ref 0 aborting False >Thread-104::DEBUG::2012-11-29 11:10:13,597::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-104::DEBUG::2012-11-29 11:10:13,597::task::588::TaskManager.Task::(_updateState) Task=`bb0254c1-4861-4f3a-8281-0456684011e2`::moving from state init -> state preparing >Thread-104::INFO::2012-11-29 11:10:13,598::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-104::DEBUG::2012-11-29 11:10:13,598::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-104::DEBUG::2012-11-29 11:10:13,598::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-104::INFO::2012-11-29 11:10:13,599::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-104::DEBUG::2012-11-29 11:10:13,599::task::1172::TaskManager.Task::(prepare) Task=`bb0254c1-4861-4f3a-8281-0456684011e2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-104::DEBUG::2012-11-29 11:10:13,599::task::588::TaskManager.Task::(_updateState) Task=`bb0254c1-4861-4f3a-8281-0456684011e2`::moving from state preparing -> state finished >Thread-104::DEBUG::2012-11-29 11:10:13,599::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-104::DEBUG::2012-11-29 11:10:13,600::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-104::DEBUG::2012-11-29 11:10:13,600::task::978::TaskManager.Task::(_decref) Task=`bb0254c1-4861-4f3a-8281-0456684011e2`::ref 0 aborting False >Thread-105::DEBUG::2012-11-29 11:10:14,629::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-105::DEBUG::2012-11-29 11:10:14,630::task::588::TaskManager.Task::(_updateState) Task=`527a1e07-28a2-4373-a00e-530eb92bc82c`::moving from state init -> state preparing >Thread-105::INFO::2012-11-29 11:10:14,630::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-105::DEBUG::2012-11-29 11:10:14,630::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-105::DEBUG::2012-11-29 11:10:14,631::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-105::INFO::2012-11-29 11:10:14,631::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-105::DEBUG::2012-11-29 11:10:14,631::task::1172::TaskManager.Task::(prepare) Task=`527a1e07-28a2-4373-a00e-530eb92bc82c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-105::DEBUG::2012-11-29 11:10:14,631::task::588::TaskManager.Task::(_updateState) Task=`527a1e07-28a2-4373-a00e-530eb92bc82c`::moving from state preparing -> state finished >Thread-105::DEBUG::2012-11-29 11:10:14,632::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-105::DEBUG::2012-11-29 11:10:14,632::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-105::DEBUG::2012-11-29 11:10:14,632::task::978::TaskManager.Task::(_decref) Task=`527a1e07-28a2-4373-a00e-530eb92bc82c`::ref 0 aborting False >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,880::safelease::178::SANLock::(acquireHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully acquired (id: 1) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::INFO::2012-11-29 11:10:14,881::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 1) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,917::safelease::235::SANLock::(acquire) Cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully acquired (id: 1) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,917::sp::263::Storage.StoragePool::(startSpm) spm lock acquired successfully >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,919::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=63c5dd33e910cffbaa66d83b1d3b903c802a143c'] >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,920::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,920::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,920::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1ba38f487807221fd8c5bc1f95aab1263cdeb519'] >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,924::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,924::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`56efdc95-3ab0-4abe-828b-631ce7309018`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,925::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,925::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,925::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`56efdc95-3ab0-4abe-828b-631ce7309018`::Granted request >1b869ebe-5376-42e5-a995-cb0cc15b9ada::INFO::2012-11-29 11:10:14,926::sp::412::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `f1008a0c-010a-45a0-b80c-f5e8514a76e7` >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,926::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`6ca06c54-461c-4771-a873-44a49152db9a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,926::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'exclusive' >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,927::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'exclusive' (1 active user) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,927::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`6ca06c54-461c-4771-a873-44a49152db9a`::Granted request >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,928::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,928::misc::1046::SamplingMethod::(__call__) Got in to sampling method >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,928::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,928::misc::1046::SamplingMethod::(__call__) Got in to sampling method >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,929::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,945::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,945::misc::1054::SamplingMethod::(__call__) Returning last result >MainProcess|1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,948::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:14,950::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-107::DEBUG::2012-11-29 11:10:15,663::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-107::DEBUG::2012-11-29 11:10:15,668::task::588::TaskManager.Task::(_updateState) Task=`d134cdb0-0b8d-42ba-b0c4-c19ef75c75ca`::moving from state init -> state preparing >Thread-107::INFO::2012-11-29 11:10:15,669::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-107::DEBUG::2012-11-29 11:10:15,669::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-107::DEBUG::2012-11-29 11:10:15,669::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-107::INFO::2012-11-29 11:10:15,670::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-107::DEBUG::2012-11-29 11:10:15,670::task::1172::TaskManager.Task::(prepare) Task=`d134cdb0-0b8d-42ba-b0c4-c19ef75c75ca`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-107::DEBUG::2012-11-29 11:10:15,670::task::588::TaskManager.Task::(_updateState) Task=`d134cdb0-0b8d-42ba-b0c4-c19ef75c75ca`::moving from state preparing -> state finished >Thread-107::DEBUG::2012-11-29 11:10:15,671::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-107::DEBUG::2012-11-29 11:10:15,671::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-107::DEBUG::2012-11-29 11:10:15,671::task::978::TaskManager.Task::(_decref) Task=`d134cdb0-0b8d-42ba-b0c4-c19ef75c75ca`::ref 0 aborting False >MainProcess|1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:15,953::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:15,960::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:15,962::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-108::DEBUG::2012-11-29 11:10:16,708::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-108::DEBUG::2012-11-29 11:10:16,709::task::588::TaskManager.Task::(_updateState) Task=`ff0d5831-3c40-4248-a1aa-c818bce3a2c2`::moving from state init -> state preparing >Thread-108::INFO::2012-11-29 11:10:16,709::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-108::DEBUG::2012-11-29 11:10:16,709::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-108::DEBUG::2012-11-29 11:10:16,710::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-108::INFO::2012-11-29 11:10:16,710::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-108::DEBUG::2012-11-29 11:10:16,710::task::1172::TaskManager.Task::(prepare) Task=`ff0d5831-3c40-4248-a1aa-c818bce3a2c2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-108::DEBUG::2012-11-29 11:10:16,711::task::588::TaskManager.Task::(_updateState) Task=`ff0d5831-3c40-4248-a1aa-c818bce3a2c2`::moving from state preparing -> state finished >Thread-108::DEBUG::2012-11-29 11:10:16,711::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-108::DEBUG::2012-11-29 11:10:16,711::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-108::DEBUG::2012-11-29 11:10:16,711::task::978::TaskManager.Task::(_decref) Task=`ff0d5831-3c40-4248-a1aa-c818bce3a2c2`::ref 0 aborting False >MainProcess|1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:16,966::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Thread-109::DEBUG::2012-11-29 11:10:17,380::task::588::TaskManager.Task::(_updateState) Task=`b8ec943e-64d3-4134-a09a-941cfbea1a3c`::moving from state init -> state preparing >Thread-109::INFO::2012-11-29 11:10:17,381::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-109::INFO::2012-11-29 11:10:17,381::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00181007385254', 'lastCheck': '2.5', 'code': 0, 'valid': True}} >Thread-109::DEBUG::2012-11-29 11:10:17,381::task::1172::TaskManager.Task::(prepare) Task=`b8ec943e-64d3-4134-a09a-941cfbea1a3c`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00181007385254', 'lastCheck': '2.5', 'code': 0, 'valid': True}} >Thread-109::DEBUG::2012-11-29 11:10:17,382::task::588::TaskManager.Task::(_updateState) Task=`b8ec943e-64d3-4134-a09a-941cfbea1a3c`::moving from state preparing -> state finished >Thread-109::DEBUG::2012-11-29 11:10:17,382::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-109::DEBUG::2012-11-29 11:10:17,382::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-109::DEBUG::2012-11-29 11:10:17,383::task::978::TaskManager.Task::(_decref) Task=`b8ec943e-64d3-4134-a09a-941cfbea1a3c`::ref 0 aborting False >Thread-111::DEBUG::2012-11-29 11:10:17,741::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-111::DEBUG::2012-11-29 11:10:17,741::task::588::TaskManager.Task::(_updateState) Task=`0b83de55-5f01-42c7-8fdb-405b45c45b02`::moving from state init -> state preparing >Thread-111::INFO::2012-11-29 11:10:17,742::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-111::DEBUG::2012-11-29 11:10:17,742::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-111::DEBUG::2012-11-29 11:10:17,742::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-111::INFO::2012-11-29 11:10:17,743::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-111::DEBUG::2012-11-29 11:10:17,743::task::1172::TaskManager.Task::(prepare) Task=`0b83de55-5f01-42c7-8fdb-405b45c45b02`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-111::DEBUG::2012-11-29 11:10:17,743::task::588::TaskManager.Task::(_updateState) Task=`0b83de55-5f01-42c7-8fdb-405b45c45b02`::moving from state preparing -> state finished >Thread-111::DEBUG::2012-11-29 11:10:17,744::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-111::DEBUG::2012-11-29 11:10:17,744::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-111::DEBUG::2012-11-29 11:10:17,744::task::978::TaskManager.Task::(_decref) Task=`0b83de55-5f01-42c7-8fdb-405b45c45b02`::ref 0 aborting False >MainProcess|1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:17,970::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-112::DEBUG::2012-11-29 11:10:18,776::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-112::DEBUG::2012-11-29 11:10:18,777::task::588::TaskManager.Task::(_updateState) Task=`dc89403b-ee18-4145-8068-967c9c7ed87d`::moving from state init -> state preparing >Thread-112::INFO::2012-11-29 11:10:18,777::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-112::DEBUG::2012-11-29 11:10:18,777::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-112::DEBUG::2012-11-29 11:10:18,777::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-112::INFO::2012-11-29 11:10:18,778::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-112::DEBUG::2012-11-29 11:10:18,778::task::1172::TaskManager.Task::(prepare) Task=`dc89403b-ee18-4145-8068-967c9c7ed87d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-112::DEBUG::2012-11-29 11:10:18,778::task::588::TaskManager.Task::(_updateState) Task=`dc89403b-ee18-4145-8068-967c9c7ed87d`::moving from state preparing -> state finished >Thread-112::DEBUG::2012-11-29 11:10:18,779::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-112::DEBUG::2012-11-29 11:10:18,779::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-112::DEBUG::2012-11-29 11:10:18,779::task::978::TaskManager.Task::(_decref) Task=`dc89403b-ee18-4145-8068-967c9c7ed87d`::ref 0 aborting False >Thread-114::DEBUG::2012-11-29 11:10:19,811::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-114::DEBUG::2012-11-29 11:10:19,812::task::588::TaskManager.Task::(_updateState) Task=`a0350c35-cda0-42b9-bf7c-c270e8189dd9`::moving from state init -> state preparing >Thread-114::INFO::2012-11-29 11:10:19,812::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-114::DEBUG::2012-11-29 11:10:19,813::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-114::DEBUG::2012-11-29 11:10:19,813::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-114::INFO::2012-11-29 11:10:19,813::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-114::DEBUG::2012-11-29 11:10:19,813::task::1172::TaskManager.Task::(prepare) Task=`a0350c35-cda0-42b9-bf7c-c270e8189dd9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-114::DEBUG::2012-11-29 11:10:19,814::task::588::TaskManager.Task::(_updateState) Task=`a0350c35-cda0-42b9-bf7c-c270e8189dd9`::moving from state preparing -> state finished >Thread-114::DEBUG::2012-11-29 11:10:19,814::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-114::DEBUG::2012-11-29 11:10:19,814::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-114::DEBUG::2012-11-29 11:10:19,815::task::978::TaskManager.Task::(_decref) Task=`a0350c35-cda0-42b9-bf7c-c270e8189dd9`::ref 0 aborting False >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:19,973::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,059::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,060::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,060::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,061::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,061::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,061::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,062::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,062::misc::1054::SamplingMethod::(__call__) Returning last result >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,062::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,064::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free f1008a0c-010a-45a0-b80c-f5e8514a76e7' (cwd None) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,219::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = ' Volume group "f1008a0c-010a-45a0-b80c-f5e8514a76e7" not found\n'; <rc> = 5 >1b869ebe-5376-42e5-a995-cb0cc15b9ada::WARNING::2012-11-29 11:10:20,220::lvm::356::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "f1008a0c-010a-45a0-b80c-f5e8514a76e7" not found'] >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,220::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,226::fileSD::124::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,226::persistentDict::185::Storage.PersistentDict::(__init__) Created a persistant dict with FileMetadataRW backend >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,229::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1ba38f487807221fd8c5bc1f95aab1263cdeb519'] >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,230::fileSD::447::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >1b869ebe-5376-42e5-a995-cb0cc15b9ada::WARNING::2012-11-29 11:10:20,230::sd::321::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS already registered >1b869ebe-5376-42e5-a995-cb0cc15b9ada::WARNING::2012-11-29 11:10:20,231::sd::327::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS already registered >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,231::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,231::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,232::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,232::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,232::sp::416::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,233::sp::423::Storage.StoragePool::(_upgradePool) Registering with state change event >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,233::sp::425::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,233::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,234::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,234::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,234::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >1b869ebe-5376-42e5-a995-cb0cc15b9ada::WARNING::2012-11-29 11:10:20,236::sd::574::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7/master/vms) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::WARNING::2012-11-29 11:10:20,237::sd::579::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7/master/tasks) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,239::sp::313::Storage.StoragePool::(startSpm) ended. >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,239::task::588::TaskManager.Task::(_updateState) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::moving from state running -> state finished >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,240::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,240::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,240::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,241::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,241::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,241::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,241::task::900::TaskManager.Task::(_runJobs) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::Task.run: exit - success: result >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,242::task::978::TaskManager.Task::(_decref) Task=`1b869ebe-5376-42e5-a995-cb0cc15b9ada`::ref 0 aborting False >1b869ebe-5376-42e5-a995-cb0cc15b9ada::DEBUG::2012-11-29 11:10:20,242::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-120::DEBUG::2012-11-29 11:10:20,845::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-120::DEBUG::2012-11-29 11:10:20,845::task::588::TaskManager.Task::(_updateState) Task=`60aaca9f-36c8-4549-96df-09269e34640e`::moving from state init -> state preparing >Thread-120::INFO::2012-11-29 11:10:20,846::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-120::DEBUG::2012-11-29 11:10:20,846::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-120::DEBUG::2012-11-29 11:10:20,847::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'} >Thread-120::INFO::2012-11-29 11:10:20,847::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-120::DEBUG::2012-11-29 11:10:20,847::task::1172::TaskManager.Task::(prepare) Task=`60aaca9f-36c8-4549-96df-09269e34640e`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1b869ebe-5376-42e5-a995-cb0cc15b9ada'}} >Thread-120::DEBUG::2012-11-29 11:10:20,848::task::588::TaskManager.Task::(_updateState) Task=`60aaca9f-36c8-4549-96df-09269e34640e`::moving from state preparing -> state finished >Thread-120::DEBUG::2012-11-29 11:10:20,848::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-120::DEBUG::2012-11-29 11:10:20,848::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-120::DEBUG::2012-11-29 11:10:20,848::task::978::TaskManager.Task::(_decref) Task=`60aaca9f-36c8-4549-96df-09269e34640e`::ref 0 aborting False >Thread-121::DEBUG::2012-11-29 11:10:20,881::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-121::DEBUG::2012-11-29 11:10:20,882::task::588::TaskManager.Task::(_updateState) Task=`930107c5-d278-48e4-8bb2-a593036ffe59`::moving from state init -> state preparing >Thread-121::INFO::2012-11-29 11:10:20,882::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-121::INFO::2012-11-29 11:10:20,883::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-121::DEBUG::2012-11-29 11:10:20,883::task::1172::TaskManager.Task::(prepare) Task=`930107c5-d278-48e4-8bb2-a593036ffe59`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-121::DEBUG::2012-11-29 11:10:20,883::task::588::TaskManager.Task::(_updateState) Task=`930107c5-d278-48e4-8bb2-a593036ffe59`::moving from state preparing -> state finished >Thread-121::DEBUG::2012-11-29 11:10:20,883::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-121::DEBUG::2012-11-29 11:10:20,884::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-121::DEBUG::2012-11-29 11:10:20,884::task::978::TaskManager.Task::(_decref) Task=`930107c5-d278-48e4-8bb2-a593036ffe59`::ref 0 aborting False >Thread-122::DEBUG::2012-11-29 11:10:20,917::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-122::DEBUG::2012-11-29 11:10:20,917::task::588::TaskManager.Task::(_updateState) Task=`6bc9c1d8-9433-42f6-ad7f-50e418b27460`::moving from state init -> state preparing >Thread-122::INFO::2012-11-29 11:10:20,918::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='1b869ebe-5376-42e5-a995-cb0cc15b9ada', spUUID=None, options=None) >Thread-122::DEBUG::2012-11-29 11:10:20,918::taskManager::161::TaskManager::(clearTask) Entry. taskID: 1b869ebe-5376-42e5-a995-cb0cc15b9ada >Thread-122::DEBUG::2012-11-29 11:10:20,918::taskManager::166::TaskManager::(clearTask) Return. >Thread-122::INFO::2012-11-29 11:10:20,919::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-122::DEBUG::2012-11-29 11:10:20,919::task::1172::TaskManager.Task::(prepare) Task=`6bc9c1d8-9433-42f6-ad7f-50e418b27460`::finished: None >Thread-122::DEBUG::2012-11-29 11:10:20,919::task::588::TaskManager.Task::(_updateState) Task=`6bc9c1d8-9433-42f6-ad7f-50e418b27460`::moving from state preparing -> state finished >Thread-122::DEBUG::2012-11-29 11:10:20,919::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-122::DEBUG::2012-11-29 11:10:20,920::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-122::DEBUG::2012-11-29 11:10:20,920::task::978::TaskManager.Task::(_decref) Task=`6bc9c1d8-9433-42f6-ad7f-50e418b27460`::ref 0 aborting False >Thread-123::DEBUG::2012-11-29 11:10:20,991::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-123::DEBUG::2012-11-29 11:10:20,992::task::588::TaskManager.Task::(_updateState) Task=`906ec6d5-e83d-4e07-bb6f-999b7238863a`::moving from state init -> state preparing >Thread-123::INFO::2012-11-29 11:10:20,993::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-123::DEBUG::2012-11-29 11:10:20,994::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`cbd21350-488d-4fdd-a30b-f314a259fc40`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-123::DEBUG::2012-11-29 11:10:20,994::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-123::DEBUG::2012-11-29 11:10:20,995::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-123::DEBUG::2012-11-29 11:10:20,995::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`cbd21350-488d-4fdd-a30b-f314a259fc40`::Granted request >Thread-123::DEBUG::2012-11-29 11:10:20,996::task::817::TaskManager.Task::(resourceAcquired) Task=`906ec6d5-e83d-4e07-bb6f-999b7238863a`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (exclusive) >Thread-123::DEBUG::2012-11-29 11:10:20,996::task::978::TaskManager.Task::(_decref) Task=`906ec6d5-e83d-4e07-bb6f-999b7238863a`::ref 1 aborting False >Thread-123::DEBUG::2012-11-29 11:10:20,997::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`1d2208fe-4a56-40a1-978f-c71db7d6c67f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-123::DEBUG::2012-11-29 11:10:20,997::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'exclusive' >Thread-123::DEBUG::2012-11-29 11:10:20,997::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'exclusive' (1 active user) >Thread-123::DEBUG::2012-11-29 11:10:20,998::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`1d2208fe-4a56-40a1-978f-c71db7d6c67f`::Granted request >Thread-123::DEBUG::2012-11-29 11:10:20,998::task::817::TaskManager.Task::(resourceAcquired) Task=`906ec6d5-e83d-4e07-bb6f-999b7238863a`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (exclusive) >Thread-123::DEBUG::2012-11-29 11:10:20,998::task::978::TaskManager.Task::(_decref) Task=`906ec6d5-e83d-4e07-bb6f-999b7238863a`::ref 1 aborting False >Thread-123::INFO::2012-11-29 11:10:20,999::sp::1049::Storage.StoragePool::(activateSD) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 >Thread-123::INFO::2012-11-29 11:10:20,999::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-123::DEBUG::2012-11-29 11:10:20,999::task::1172::TaskManager.Task::(prepare) Task=`906ec6d5-e83d-4e07-bb6f-999b7238863a`::finished: None >Thread-123::DEBUG::2012-11-29 11:10:21,000::task::588::TaskManager.Task::(_updateState) Task=`906ec6d5-e83d-4e07-bb6f-999b7238863a`::moving from state preparing -> state finished >Thread-123::DEBUG::2012-11-29 11:10:21,000::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>, 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-123::DEBUG::2012-11-29 11:10:21,000::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-123::DEBUG::2012-11-29 11:10:21,001::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-123::DEBUG::2012-11-29 11:10:21,001::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-123::DEBUG::2012-11-29 11:10:21,001::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-123::DEBUG::2012-11-29 11:10:21,002::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-123::DEBUG::2012-11-29 11:10:21,002::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-123::DEBUG::2012-11-29 11:10:21,002::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-123::DEBUG::2012-11-29 11:10:21,003::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-123::DEBUG::2012-11-29 11:10:21,003::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-123::DEBUG::2012-11-29 11:10:21,003::task::978::TaskManager.Task::(_decref) Task=`906ec6d5-e83d-4e07-bb6f-999b7238863a`::ref 0 aborting False >Thread-124::DEBUG::2012-11-29 11:10:21,078::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-124::DEBUG::2012-11-29 11:10:21,078::task::588::TaskManager.Task::(_updateState) Task=`8f33bab5-0c72-452b-b4c6-e554e828876f`::moving from state init -> state preparing >Thread-124::INFO::2012-11-29 11:10:21,079::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', hostID=1, scsiKey='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', msdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', masterVersion=1, options=None) >Thread-124::DEBUG::2012-11-29 11:10:21,079::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`865c35a4-36de-4718-9b36-ddae3a63c9e5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-124::DEBUG::2012-11-29 11:10:21,079::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-124::DEBUG::2012-11-29 11:10:21,080::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-124::DEBUG::2012-11-29 11:10:21,080::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`865c35a4-36de-4718-9b36-ddae3a63c9e5`::Granted request >Thread-124::DEBUG::2012-11-29 11:10:21,081::sp::1539::Storage.StoragePool::(getMasterDomain) Master domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 verified, version 1 >Thread-124::DEBUG::2012-11-29 11:10:21,081::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-124::DEBUG::2012-11-29 11:10:21,081::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-124::DEBUG::2012-11-29 11:10:21,082::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-124::DEBUG::2012-11-29 11:10:21,082::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-124::INFO::2012-11-29 11:10:21,082::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-124::DEBUG::2012-11-29 11:10:21,082::task::1172::TaskManager.Task::(prepare) Task=`8f33bab5-0c72-452b-b4c6-e554e828876f`::finished: None >Thread-124::DEBUG::2012-11-29 11:10:21,083::task::588::TaskManager.Task::(_updateState) Task=`8f33bab5-0c72-452b-b4c6-e554e828876f`::moving from state preparing -> state finished >Thread-124::DEBUG::2012-11-29 11:10:21,083::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-124::DEBUG::2012-11-29 11:10:21,083::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-124::DEBUG::2012-11-29 11:10:21,084::task::978::TaskManager.Task::(_decref) Task=`8f33bab5-0c72-452b-b4c6-e554e828876f`::ref 0 aborting False >Thread-126::DEBUG::2012-11-29 11:10:22,293::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-126::DEBUG::2012-11-29 11:10:22,293::task::588::TaskManager.Task::(_updateState) Task=`795d157c-4ebf-4760-b150-95060bf8e2ae`::moving from state init -> state preparing >Thread-126::INFO::2012-11-29 11:10:22,294::logUtils::37::dispatcher::(wrapper) Run and protect: setStorageDomainDescription(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', description='DataDomainRestUpd', options=None) >Thread-126::DEBUG::2012-11-29 11:10:22,294::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`eebd084e-8786-4334-b014-722f7be5a8ea`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-126::DEBUG::2012-11-29 11:10:22,294::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'exclusive' >Thread-126::DEBUG::2012-11-29 11:10:22,295::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'exclusive' (1 active user) >Thread-126::DEBUG::2012-11-29 11:10:22,295::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`eebd084e-8786-4334-b014-722f7be5a8ea`::Granted request >Thread-126::DEBUG::2012-11-29 11:10:22,296::task::817::TaskManager.Task::(resourceAcquired) Task=`795d157c-4ebf-4760-b150-95060bf8e2ae`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (exclusive) >Thread-126::DEBUG::2012-11-29 11:10:22,296::task::978::TaskManager.Task::(_decref) Task=`795d157c-4ebf-4760-b150-95060bf8e2ae`::ref 1 aborting False >Thread-126::INFO::2012-11-29 11:10:22,296::sd::631::Storage.StorageDomain::(setDescription) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 descr=DataDomainRestUpd >Thread-126::DEBUG::2012-11-29 11:10:22,296::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >Thread-126::DEBUG::2012-11-29 11:10:22,297::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >Thread-126::DEBUG::2012-11-29 11:10:22,297::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c43d247ba3b2c5cfee7853bd064c721de3fe84ef'] >Thread-126::DEBUG::2012-11-29 11:10:22,301::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >Thread-126::INFO::2012-11-29 11:10:22,301::logUtils::39::dispatcher::(wrapper) Run and protect: setStorageDomainDescription, Return response: None >Thread-126::DEBUG::2012-11-29 11:10:22,302::task::1172::TaskManager.Task::(prepare) Task=`795d157c-4ebf-4760-b150-95060bf8e2ae`::finished: None >Thread-126::DEBUG::2012-11-29 11:10:22,302::task::588::TaskManager.Task::(_updateState) Task=`795d157c-4ebf-4760-b150-95060bf8e2ae`::moving from state preparing -> state finished >Thread-126::DEBUG::2012-11-29 11:10:22,302::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-126::DEBUG::2012-11-29 11:10:22,303::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-126::DEBUG::2012-11-29 11:10:22,303::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-126::DEBUG::2012-11-29 11:10:22,303::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-126::DEBUG::2012-11-29 11:10:22,304::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-126::DEBUG::2012-11-29 11:10:22,304::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-126::DEBUG::2012-11-29 11:10:22,304::task::978::TaskManager.Task::(_decref) Task=`795d157c-4ebf-4760-b150-95060bf8e2ae`::ref 0 aborting False >Thread-129::DEBUG::2012-11-29 11:10:27,620::task::588::TaskManager.Task::(_updateState) Task=`6d317755-fcef-4699-b4ba-c803cb95a6d8`::moving from state init -> state preparing >Thread-129::INFO::2012-11-29 11:10:27,621::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-129::INFO::2012-11-29 11:10:27,621::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.0015652179718', 'lastCheck': '2.7', 'code': 0, 'valid': True}} >Thread-129::DEBUG::2012-11-29 11:10:27,621::task::1172::TaskManager.Task::(prepare) Task=`6d317755-fcef-4699-b4ba-c803cb95a6d8`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.0015652179718', 'lastCheck': '2.7', 'code': 0, 'valid': True}} >Thread-129::DEBUG::2012-11-29 11:10:27,622::task::588::TaskManager.Task::(_updateState) Task=`6d317755-fcef-4699-b4ba-c803cb95a6d8`::moving from state preparing -> state finished >Thread-129::DEBUG::2012-11-29 11:10:27,622::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-129::DEBUG::2012-11-29 11:10:27,622::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-129::DEBUG::2012-11-29 11:10:27,623::task::978::TaskManager.Task::(_decref) Task=`6d317755-fcef-4699-b4ba-c803cb95a6d8`::ref 0 aborting False >Thread-131::DEBUG::2012-11-29 11:10:27,976::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-131::DEBUG::2012-11-29 11:10:27,977::task::588::TaskManager.Task::(_updateState) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::moving from state init -> state preparing >Thread-131::INFO::2012-11-29 11:10:27,977::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', imgUUID='66aec8c2-6186-4b29-a0ad-22137322f1ab', size='2147483648', volFormat=4, preallocate=2, diskType=2, volUUID='468c66cc-effa-42af-b577-d99095c6964d', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-131::INFO::2012-11-29 11:10:27,977::fileSD::255::Storage.StorageDomain::(validate) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-131::DEBUG::2012-11-29 11:10:27,980::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c43d247ba3b2c5cfee7853bd064c721de3fe84ef'] >Thread-131::DEBUG::2012-11-29 11:10:27,981::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`5b12c0a4-b8b3-4aeb-a588-7880e1f9a66b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-131::DEBUG::2012-11-29 11:10:27,981::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-131::DEBUG::2012-11-29 11:10:27,981::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-131::DEBUG::2012-11-29 11:10:27,982::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`5b12c0a4-b8b3-4aeb-a588-7880e1f9a66b`::Granted request >Thread-131::DEBUG::2012-11-29 11:10:27,982::task::817::TaskManager.Task::(resourceAcquired) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-131::DEBUG::2012-11-29 11:10:27,982::task::978::TaskManager.Task::(_decref) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::ref 1 aborting False >Thread-131::DEBUG::2012-11-29 11:10:27,984::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >Thread-131::DEBUG::2012-11-29 11:10:27,992::taskManager::66::TaskManager::(scheduleJob) scheduled job createVolume for task 5c255655-e3ca-428b-bb3e-ce4c27d2b6eb >Thread-131::INFO::2012-11-29 11:10:27,993::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-131::DEBUG::2012-11-29 11:10:27,993::task::1167::TaskManager.Task::(prepare) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::Prepare: 1 jobs exist, move to acquiring >Thread-131::DEBUG::2012-11-29 11:10:27,993::task::588::TaskManager.Task::(_updateState) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::moving from state preparing -> state acquiring >Thread-131::DEBUG::2012-11-29 11:10:27,994::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >Thread-131::DEBUG::2012-11-29 11:10:28,004::task::588::TaskManager.Task::(_updateState) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::moving from state acquiring -> state queued >Thread-131::DEBUG::2012-11-29 11:10:28,005::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >Thread-131::DEBUG::2012-11-29 11:10:28,016::taskManager::48::TaskManager::(_queueTask) queueing task: 5c255655-e3ca-428b-bb3e-ce4c27d2b6eb >Thread-131::DEBUG::2012-11-29 11:10:28,017::taskManager::54::TaskManager::(_queueTask) task queued: 5c255655-e3ca-428b-bb3e-ce4c27d2b6eb >Thread-1::DEBUG::2012-11-29 11:10:28,017::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-131::DEBUG::2012-11-29 11:10:28,017::task::1169::TaskManager.Task::(prepare) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::returning >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,017::threadPool::212::Misc.ThreadPool.WorkerThread::(run) Task: 5c255655-e3ca-428b-bb3e-ce4c27d2b6eb running: <bound method Task.commit of <storage.task.Task instance at 0x136ab48>> with: None >Thread-131::DEBUG::2012-11-29 11:10:28,018::task::978::TaskManager.Task::(_decref) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::ref 0 aborting False >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,018::task::1181::TaskManager.Task::(commit) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::Commiting task: 5c255655-e3ca-428b-bb3e-ce4c27d2b6eb >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,019::task::588::TaskManager.Task::(_updateState) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::moving from state queued -> state running >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,020::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,032::task::892::TaskManager.Task::(_runJobs) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x12ada90>> (args: ('f1008a0c-010a-45a0-b80c-f5e8514a76e7', '66aec8c2-6186-4b29-a0ad-22137322f1ab', 4194304, 4, 2, 2, '468c66cc-effa-42af-b577-d99095c6964d', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,032::task::317::TaskManager.Task::(run) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x12ada90>> (args: ('f1008a0c-010a-45a0-b80c-f5e8514a76e7', '66aec8c2-6186-4b29-a0ad-22137322f1ab', 4194304, 4, 2, 2, '468c66cc-effa-42af-b577-d99095c6964d', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,033::resourceManager::175::ResourceManager.Request::(__init__) ResName=`f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab`ReqID=`95a32ef7-0fcd-4403-9cd4-8c9f30a6e1ed`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,033::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' for lock type 'exclusive' >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,034::resourceFactories::119::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 66aec8c2-6186-4b29-a0ad-22137322f1ab does not exist in domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,034::resourceManager::528::ResourceManager::(registerResource) Resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' is free. Now locking as 'exclusive' (1 active user) >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,035::resourceManager::212::ResourceManager.Request::(grant) ResName=`f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab`ReqID=`95a32ef7-0fcd-4403-9cd4-8c9f30a6e1ed`::Granted request >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::INFO::2012-11-29 11:10:28,035::image::119::Storage.Image::(create) Create placeholder /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/66aec8c2-6186-4b29-a0ad-22137322f1ab for image's volumes >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,036::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::INFO::2012-11-29 11:10:28,050::volume::457::Storage.Volume::(create) Creating volume 468c66cc-effa-42af-b577-d99095c6964d >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,051::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,065::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::INFO::2012-11-29 11:10:28,083::fileVolume::153::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d with size = 4194304 sectors >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,084::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d 2097152K' (cwd None) >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,103::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,147::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,169::fileVolume::401::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=468c66cc-effa-42af-b577-d99095c6964d sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7, metaId=('/rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d',) >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,189::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,207::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,207::resourceManager::553::ResourceManager::(releaseResource) Released resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' (0 active users) >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,208::resourceManager::558::ResourceManager::(releaseResource) Resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' is free, finding out if anyone is waiting for it. >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,208::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab', Clearing records. >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,208::task::588::TaskManager.Task::(_updateState) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::moving from state running -> state finished >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,209::task::740::TaskManager.Task::(_save) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/5c255655-e3ca-428b-bb3e-ce4c27d2b6eb.temp >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,226::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,226::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,227::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,227::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,227::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,227::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,228::task::900::TaskManager.Task::(_runJobs) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::Task.run: exit - success: result {'uuid': '468c66cc-effa-42af-b577-d99095c6964d'} >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,228::task::978::TaskManager.Task::(_decref) Task=`5c255655-e3ca-428b-bb3e-ce4c27d2b6eb`::ref 0 aborting False >5c255655-e3ca-428b-bb3e-ce4c27d2b6eb::DEBUG::2012-11-29 11:10:28,228::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-133::DEBUG::2012-11-29 11:10:29,906::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-133::DEBUG::2012-11-29 11:10:29,907::task::588::TaskManager.Task::(_updateState) Task=`a8ede044-a2f7-4b99-ad80-75417a83c698`::moving from state init -> state preparing >Thread-133::INFO::2012-11-29 11:10:29,907::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-133::DEBUG::2012-11-29 11:10:29,907::taskManager::103::TaskManager::(getAllTasksStatuses) Entry. >Thread-133::DEBUG::2012-11-29 11:10:29,908::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5c255655-e3ca-428b-bb3e-ce4c27d2b6eb >Thread-133::DEBUG::2012-11-29 11:10:29,908::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5c255655-e3ca-428b-bb3e-ce4c27d2b6eb'} >Thread-133::DEBUG::2012-11-29 11:10:29,908::taskManager::112::TaskManager::(getAllTasksStatuses) Return: {'5c255655-e3ca-428b-bb3e-ce4c27d2b6eb': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5c255655-e3ca-428b-bb3e-ce4c27d2b6eb'}} >Thread-133::INFO::2012-11-29 11:10:29,908::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'5c255655-e3ca-428b-bb3e-ce4c27d2b6eb': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5c255655-e3ca-428b-bb3e-ce4c27d2b6eb'}}} >Thread-133::DEBUG::2012-11-29 11:10:29,909::task::1172::TaskManager.Task::(prepare) Task=`a8ede044-a2f7-4b99-ad80-75417a83c698`::finished: {'allTasksStatus': {'5c255655-e3ca-428b-bb3e-ce4c27d2b6eb': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5c255655-e3ca-428b-bb3e-ce4c27d2b6eb'}}} >Thread-133::DEBUG::2012-11-29 11:10:29,909::task::588::TaskManager.Task::(_updateState) Task=`a8ede044-a2f7-4b99-ad80-75417a83c698`::moving from state preparing -> state finished >Thread-133::DEBUG::2012-11-29 11:10:29,909::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-133::DEBUG::2012-11-29 11:10:29,910::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-133::DEBUG::2012-11-29 11:10:29,910::task::978::TaskManager.Task::(_decref) Task=`a8ede044-a2f7-4b99-ad80-75417a83c698`::ref 0 aborting False >Thread-134::DEBUG::2012-11-29 11:10:29,989::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-134::DEBUG::2012-11-29 11:10:29,989::task::588::TaskManager.Task::(_updateState) Task=`24b91f16-6e21-4ffc-bd4d-ea014c25e15a`::moving from state init -> state preparing >Thread-134::INFO::2012-11-29 11:10:29,990::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', imgUUID='66aec8c2-6186-4b29-a0ad-22137322f1ab', volUUID='468c66cc-effa-42af-b577-d99095c6964d', options=None) >Thread-134::DEBUG::2012-11-29 11:10:29,991::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`8eff2618-b003-411e-bfc2-4bb8afe5ba8a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-134::DEBUG::2012-11-29 11:10:29,991::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-134::DEBUG::2012-11-29 11:10:29,991::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-134::DEBUG::2012-11-29 11:10:29,992::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`8eff2618-b003-411e-bfc2-4bb8afe5ba8a`::Granted request >Thread-134::DEBUG::2012-11-29 11:10:29,992::task::817::TaskManager.Task::(resourceAcquired) Task=`24b91f16-6e21-4ffc-bd4d-ea014c25e15a`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-134::DEBUG::2012-11-29 11:10:29,992::task::978::TaskManager.Task::(_decref) Task=`24b91f16-6e21-4ffc-bd4d-ea014c25e15a`::ref 1 aborting False >Thread-134::DEBUG::2012-11-29 11:10:29,994::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-134::INFO::2012-11-29 11:10:29,996::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 imgUUID=66aec8c2-6186-4b29-a0ad-22137322f1ab volUUID = 468c66cc-effa-42af-b577-d99095c6964d >Thread-134::DEBUG::2012-11-29 11:10:30,003::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-134::DEBUG::2012-11-29 11:10:30,006::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-134::INFO::2012-11-29 11:10:30,008::volume::824::Storage.Volume::(getInfo) f1008a0c-010a-45a0-b80c-f5e8514a76e7/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d info is {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'} >Thread-134::INFO::2012-11-29 11:10:30,009::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-134::DEBUG::2012-11-29 11:10:30,009::task::1172::TaskManager.Task::(prepare) Task=`24b91f16-6e21-4ffc-bd4d-ea014c25e15a`::finished: {'info': {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-134::DEBUG::2012-11-29 11:10:30,009::task::588::TaskManager.Task::(_updateState) Task=`24b91f16-6e21-4ffc-bd4d-ea014c25e15a`::moving from state preparing -> state finished >Thread-134::DEBUG::2012-11-29 11:10:30,009::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-134::DEBUG::2012-11-29 11:10:30,010::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134::DEBUG::2012-11-29 11:10:30,010::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-134::DEBUG::2012-11-29 11:10:30,010::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-134::DEBUG::2012-11-29 11:10:30,011::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-134::DEBUG::2012-11-29 11:10:30,011::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-134::DEBUG::2012-11-29 11:10:30,011::task::978::TaskManager.Task::(_decref) Task=`24b91f16-6e21-4ffc-bd4d-ea014c25e15a`::ref 0 aborting False >Thread-135::DEBUG::2012-11-29 11:10:30,204::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-135::DEBUG::2012-11-29 11:10:30,204::task::588::TaskManager.Task::(_updateState) Task=`709e4982-45a4-45ba-b80c-923ef0b1f4ae`::moving from state init -> state preparing >Thread-135::INFO::2012-11-29 11:10:30,205::logUtils::37::dispatcher::(wrapper) Run and protect: updateVM(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', vmList=[{'imglist': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.1.0.0"><References><File ovf:href="66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d" ovf:id="468c66cc-effa-42af-b577-d99095c6964d" ovf:size="2147483648" ovf:description="Active VM"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="468c66cc-effa-42af-b577-d99095c6964d" ovf:size="2" ovf:actual_size="0" ovf:vm_snapshot_id="52d97dd5-d7c6-412f-889e-74587d8f3429" ovf:parentRef="" ovf:fileRef="66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="IDE" ovf:boot="false" ovf:disk-alias="restvm_templates_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Name>restvm_templates</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><Description></Description><Domain></Domain><CreationDate>2012/11/29 09:10:24</CreationDate><ExportDate>2012/11/29 09:10:30</ExportDate><IsInitilized>false</IsInitilized><IsAutoSuspend>false</IsAutoSuspend><TimeZone></TimeZone><IsStateless>false</IsStateless><Origin>0</Origin><default_boot_sequence>0</default_boot_sequence><quota_id>00000000-0000-0000-0000-000000000000</quota_id><VmType>0</VmType><DefaultDisplayType>1</DefaultDisplayType><MinAllocatedMem>1024</MinAllocatedMem><Section ovf:id="7c76ce48-a3a4-4410-8050-a6617c3f5e8b" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>Unassigned</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.1.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>restvm_templates_Disk1</rasd:Caption><rasd:InstanceId>468c66cc-effa-42af-b577-d99095c6964d</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>f1008a0c-010a-45a0-b80c-f5e8514a76e7</rasd:StorageId><rasd:StoragePoolId>21ea8081-3262-478a-8e4a-8e46b0e2fbc9</rasd:StoragePoolId><rasd:CreationDate>2012/11/29 09:10:28</rasd:CreationDate><rasd:LastModified>2012/11/29 09:10:28</rasd:LastModified><rasd:last_modified_date>2012/11/29 09:10:30</rasd:last_modified_date></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>\n', 'vm': '7c76ce48-a3a4-4410-8050-a6617c3f5e8b'}], sdUUID=None, options=None) >Thread-135::DEBUG::2012-11-29 11:10:30,205::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`461187bd-498c-4bfa-9c33-dbedfcb833b8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-135::DEBUG::2012-11-29 11:10:30,206::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-135::DEBUG::2012-11-29 11:10:30,206::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-135::DEBUG::2012-11-29 11:10:30,206::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`461187bd-498c-4bfa-9c33-dbedfcb833b8`::Granted request >Thread-135::DEBUG::2012-11-29 11:10:30,207::task::817::TaskManager.Task::(resourceAcquired) Task=`709e4982-45a4-45ba-b80c-923ef0b1f4ae`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-135::DEBUG::2012-11-29 11:10:30,207::task::978::TaskManager.Task::(_decref) Task=`709e4982-45a4-45ba-b80c-923ef0b1f4ae`::ref 1 aborting False >Thread-135::INFO::2012-11-29 11:10:30,207::sp::1262::Storage.StoragePool::(updateVM) spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-135::INFO::2012-11-29 11:10:30,208::sp::1273::Storage.StoragePool::(updateVM) vmUUID=7c76ce48-a3a4-4410-8050-a6617c3f5e8b imgList=['66aec8c2-6186-4b29-a0ad-22137322f1ab'] >Thread-135::INFO::2012-11-29 11:10:30,211::logUtils::39::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-135::DEBUG::2012-11-29 11:10:30,212::task::1172::TaskManager.Task::(prepare) Task=`709e4982-45a4-45ba-b80c-923ef0b1f4ae`::finished: None >Thread-135::DEBUG::2012-11-29 11:10:30,212::task::588::TaskManager.Task::(_updateState) Task=`709e4982-45a4-45ba-b80c-923ef0b1f4ae`::moving from state preparing -> state finished >Thread-135::DEBUG::2012-11-29 11:10:30,212::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-135::DEBUG::2012-11-29 11:10:30,212::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135::DEBUG::2012-11-29 11:10:30,213::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-135::DEBUG::2012-11-29 11:10:30,213::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-135::DEBUG::2012-11-29 11:10:30,213::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-135::DEBUG::2012-11-29 11:10:30,214::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-135::DEBUG::2012-11-29 11:10:30,214::task::978::TaskManager.Task::(_decref) Task=`709e4982-45a4-45ba-b80c-923ef0b1f4ae`::ref 0 aborting False >Thread-136::DEBUG::2012-11-29 11:10:30,272::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-136::DEBUG::2012-11-29 11:10:30,272::task::588::TaskManager.Task::(_updateState) Task=`50dda1fa-c3bc-4068-b83b-a233e4bd5af2`::moving from state init -> state preparing >Thread-136::INFO::2012-11-29 11:10:30,273::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='5c255655-e3ca-428b-bb3e-ce4c27d2b6eb', spUUID=None, options=None) >Thread-136::DEBUG::2012-11-29 11:10:30,273::taskManager::161::TaskManager::(clearTask) Entry. taskID: 5c255655-e3ca-428b-bb3e-ce4c27d2b6eb >Thread-136::DEBUG::2012-11-29 11:10:30,280::taskManager::166::TaskManager::(clearTask) Return. >Thread-136::INFO::2012-11-29 11:10:30,280::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-136::DEBUG::2012-11-29 11:10:30,280::task::1172::TaskManager.Task::(prepare) Task=`50dda1fa-c3bc-4068-b83b-a233e4bd5af2`::finished: None >Thread-136::DEBUG::2012-11-29 11:10:30,281::task::588::TaskManager.Task::(_updateState) Task=`50dda1fa-c3bc-4068-b83b-a233e4bd5af2`::moving from state preparing -> state finished >Thread-136::DEBUG::2012-11-29 11:10:30,281::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136::DEBUG::2012-11-29 11:10:30,281::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136::DEBUG::2012-11-29 11:10:30,282::task::978::TaskManager.Task::(_decref) Task=`50dda1fa-c3bc-4068-b83b-a233e4bd5af2`::ref 0 aborting False >Thread-137::DEBUG::2012-11-29 11:10:31,039::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-137::DEBUG::2012-11-29 11:10:31,040::task::588::TaskManager.Task::(_updateState) Task=`5f463883-5f1a-4467-8c22-9e9a48c50118`::moving from state init -> state preparing >Thread-137::INFO::2012-11-29 11:10:31,040::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-137::INFO::2012-11-29 11:10:31,041::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-137::DEBUG::2012-11-29 11:10:31,041::task::1172::TaskManager.Task::(prepare) Task=`5f463883-5f1a-4467-8c22-9e9a48c50118`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-137::DEBUG::2012-11-29 11:10:31,041::task::588::TaskManager.Task::(_updateState) Task=`5f463883-5f1a-4467-8c22-9e9a48c50118`::moving from state preparing -> state finished >Thread-137::DEBUG::2012-11-29 11:10:31,041::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137::DEBUG::2012-11-29 11:10:31,042::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137::DEBUG::2012-11-29 11:10:31,042::task::978::TaskManager.Task::(_decref) Task=`5f463883-5f1a-4467-8c22-9e9a48c50118`::ref 0 aborting False >Thread-138::DEBUG::2012-11-29 11:10:31,073::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-138::DEBUG::2012-11-29 11:10:31,073::task::588::TaskManager.Task::(_updateState) Task=`3c2a0d74-76d7-4c27-9563-55f4d3dde15f`::moving from state init -> state preparing >Thread-138::INFO::2012-11-29 11:10:31,074::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-138::DEBUG::2012-11-29 11:10:31,074::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`bb4b4ac4-82fc-4c5b-91a0-fbd6692046fe`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-138::DEBUG::2012-11-29 11:10:31,074::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-138::DEBUG::2012-11-29 11:10:31,075::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-138::DEBUG::2012-11-29 11:10:31,075::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`bb4b4ac4-82fc-4c5b-91a0-fbd6692046fe`::Granted request >Thread-138::DEBUG::2012-11-29 11:10:31,075::task::817::TaskManager.Task::(resourceAcquired) Task=`3c2a0d74-76d7-4c27-9563-55f4d3dde15f`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-138::DEBUG::2012-11-29 11:10:31,076::task::978::TaskManager.Task::(_decref) Task=`3c2a0d74-76d7-4c27-9563-55f4d3dde15f`::ref 1 aborting False >Thread-138::INFO::2012-11-29 11:10:31,078::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862431739904'}}} >Thread-138::DEBUG::2012-11-29 11:10:31,079::task::1172::TaskManager.Task::(prepare) Task=`3c2a0d74-76d7-4c27-9563-55f4d3dde15f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862431739904'}}} >Thread-138::DEBUG::2012-11-29 11:10:31,079::task::588::TaskManager.Task::(_updateState) Task=`3c2a0d74-76d7-4c27-9563-55f4d3dde15f`::moving from state preparing -> state finished >Thread-138::DEBUG::2012-11-29 11:10:31,079::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-138::DEBUG::2012-11-29 11:10:31,079::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138::DEBUG::2012-11-29 11:10:31,080::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-138::DEBUG::2012-11-29 11:10:31,080::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-138::DEBUG::2012-11-29 11:10:31,080::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-138::DEBUG::2012-11-29 11:10:31,081::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-138::DEBUG::2012-11-29 11:10:31,081::task::978::TaskManager.Task::(_decref) Task=`3c2a0d74-76d7-4c27-9563-55f4d3dde15f`::ref 0 aborting False >Thread-142::DEBUG::2012-11-29 11:10:37,879::task::588::TaskManager.Task::(_updateState) Task=`11e9d6db-c1e6-4512-8340-ebe4c5319382`::moving from state init -> state preparing >Thread-142::INFO::2012-11-29 11:10:37,879::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-142::INFO::2012-11-29 11:10:37,880::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00173497200012', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-142::DEBUG::2012-11-29 11:10:37,880::task::1172::TaskManager.Task::(prepare) Task=`11e9d6db-c1e6-4512-8340-ebe4c5319382`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00173497200012', 'lastCheck': '3.0', 'code': 0, 'valid': True}} >Thread-142::DEBUG::2012-11-29 11:10:37,880::task::588::TaskManager.Task::(_updateState) Task=`11e9d6db-c1e6-4512-8340-ebe4c5319382`::moving from state preparing -> state finished >Thread-142::DEBUG::2012-11-29 11:10:37,881::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-142::DEBUG::2012-11-29 11:10:37,881::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-142::DEBUG::2012-11-29 11:10:37,881::task::978::TaskManager.Task::(_decref) Task=`11e9d6db-c1e6-4512-8340-ebe4c5319382`::ref 0 aborting False >Thread-144::DEBUG::2012-11-29 11:10:39,759::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-144::DEBUG::2012-11-29 11:10:39,760::task::588::TaskManager.Task::(_updateState) Task=`d6032f11-719d-4725-bd06-dc9ef549b6cf`::moving from state init -> state preparing >Thread-144::INFO::2012-11-29 11:10:39,760::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', imgUUID='66aec8c2-6186-4b29-a0ad-22137322f1ab', volUUID='468c66cc-effa-42af-b577-d99095c6964d', options=None) >Thread-144::DEBUG::2012-11-29 11:10:39,761::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`1829d726-dbe1-4fbf-bf36-b438cd18586e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-144::DEBUG::2012-11-29 11:10:39,761::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-144::DEBUG::2012-11-29 11:10:39,761::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-144::DEBUG::2012-11-29 11:10:39,762::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`1829d726-dbe1-4fbf-bf36-b438cd18586e`::Granted request >Thread-144::DEBUG::2012-11-29 11:10:39,762::task::817::TaskManager.Task::(resourceAcquired) Task=`d6032f11-719d-4725-bd06-dc9ef549b6cf`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-144::DEBUG::2012-11-29 11:10:39,762::task::978::TaskManager.Task::(_decref) Task=`d6032f11-719d-4725-bd06-dc9ef549b6cf`::ref 1 aborting False >Thread-144::DEBUG::2012-11-29 11:10:39,764::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-144::INFO::2012-11-29 11:10:39,765::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 imgUUID=66aec8c2-6186-4b29-a0ad-22137322f1ab volUUID = 468c66cc-effa-42af-b577-d99095c6964d >Thread-144::DEBUG::2012-11-29 11:10:39,772::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-144::DEBUG::2012-11-29 11:10:39,775::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-144::INFO::2012-11-29 11:10:39,777::volume::824::Storage.Volume::(getInfo) f1008a0c-010a-45a0-b80c-f5e8514a76e7/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d info is {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'} >Thread-144::INFO::2012-11-29 11:10:39,777::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-144::DEBUG::2012-11-29 11:10:39,778::task::1172::TaskManager.Task::(prepare) Task=`d6032f11-719d-4725-bd06-dc9ef549b6cf`::finished: {'info': {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-144::DEBUG::2012-11-29 11:10:39,778::task::588::TaskManager.Task::(_updateState) Task=`d6032f11-719d-4725-bd06-dc9ef549b6cf`::moving from state preparing -> state finished >Thread-144::DEBUG::2012-11-29 11:10:39,778::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-144::DEBUG::2012-11-29 11:10:39,779::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-144::DEBUG::2012-11-29 11:10:39,779::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-144::DEBUG::2012-11-29 11:10:39,779::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-144::DEBUG::2012-11-29 11:10:39,780::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-144::DEBUG::2012-11-29 11:10:39,780::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-144::DEBUG::2012-11-29 11:10:39,780::task::978::TaskManager.Task::(_decref) Task=`d6032f11-719d-4725-bd06-dc9ef549b6cf`::ref 0 aborting False >Thread-145::DEBUG::2012-11-29 11:10:39,851::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-145::DEBUG::2012-11-29 11:10:39,851::task::588::TaskManager.Task::(_updateState) Task=`35a8631f-73ff-4032-9f10-e6b7a225c145`::moving from state init -> state preparing >Thread-145::INFO::2012-11-29 11:10:39,852::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', imgUUID='66aec8c2-6186-4b29-a0ad-22137322f1ab', volUUID='468c66cc-effa-42af-b577-d99095c6964d', options=None) >Thread-145::DEBUG::2012-11-29 11:10:39,852::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`cf00e6aa-d352-42fe-8356-1e47cc1d10a9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-145::DEBUG::2012-11-29 11:10:39,852::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-145::DEBUG::2012-11-29 11:10:39,853::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-145::DEBUG::2012-11-29 11:10:39,853::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`cf00e6aa-d352-42fe-8356-1e47cc1d10a9`::Granted request >Thread-145::DEBUG::2012-11-29 11:10:39,853::task::817::TaskManager.Task::(resourceAcquired) Task=`35a8631f-73ff-4032-9f10-e6b7a225c145`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-145::DEBUG::2012-11-29 11:10:39,854::task::978::TaskManager.Task::(_decref) Task=`35a8631f-73ff-4032-9f10-e6b7a225c145`::ref 1 aborting False >Thread-145::DEBUG::2012-11-29 11:10:39,855::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-145::INFO::2012-11-29 11:10:39,856::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 imgUUID=66aec8c2-6186-4b29-a0ad-22137322f1ab volUUID = 468c66cc-effa-42af-b577-d99095c6964d >Thread-145::DEBUG::2012-11-29 11:10:39,863::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-145::DEBUG::2012-11-29 11:10:39,866::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-145::INFO::2012-11-29 11:10:39,868::volume::824::Storage.Volume::(getInfo) f1008a0c-010a-45a0-b80c-f5e8514a76e7/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d info is {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'} >Thread-145::INFO::2012-11-29 11:10:39,868::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-145::DEBUG::2012-11-29 11:10:39,869::task::1172::TaskManager.Task::(prepare) Task=`35a8631f-73ff-4032-9f10-e6b7a225c145`::finished: {'info': {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '66aec8c2-6186-4b29-a0ad-22137322f1ab', 'ctime': '1354180228', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180228', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '468c66cc-effa-42af-b577-d99095c6964d', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-145::DEBUG::2012-11-29 11:10:39,869::task::588::TaskManager.Task::(_updateState) Task=`35a8631f-73ff-4032-9f10-e6b7a225c145`::moving from state preparing -> state finished >Thread-145::DEBUG::2012-11-29 11:10:39,869::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-145::DEBUG::2012-11-29 11:10:39,870::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-145::DEBUG::2012-11-29 11:10:39,870::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-145::DEBUG::2012-11-29 11:10:39,870::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-145::DEBUG::2012-11-29 11:10:39,871::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-145::DEBUG::2012-11-29 11:10:39,871::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-145::DEBUG::2012-11-29 11:10:39,871::task::978::TaskManager.Task::(_decref) Task=`35a8631f-73ff-4032-9f10-e6b7a225c145`::ref 0 aborting False >Thread-146::DEBUG::2012-11-29 11:10:39,908::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-146::DEBUG::2012-11-29 11:10:39,908::task::588::TaskManager.Task::(_updateState) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::moving from state init -> state preparing >Thread-146::INFO::2012-11-29 11:10:39,909::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', vmUUID='', srcImgUUID='66aec8c2-6186-4b29-a0ad-22137322f1ab', srcVolUUID='468c66cc-effa-42af-b577-d99095c6964d', dstImgUUID='2cee16ba-639a-4980-8a42-9a667b3d2b48', dstVolUUID='0ecfa26d-1fc8-4ea7-994f-41f1b9529d53', description='Active VM', dstSdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', volType=6, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-146::INFO::2012-11-29 11:10:39,909::fileSD::255::Storage.StorageDomain::(validate) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-146::DEBUG::2012-11-29 11:10:39,911::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c43d247ba3b2c5cfee7853bd064c721de3fe84ef'] >Thread-146::DEBUG::2012-11-29 11:10:39,913::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-146::INFO::2012-11-29 11:10:39,915::image::457::Storage.Image::(isLegal) image 66aec8c2-6186-4b29-a0ad-22137322f1ab in domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 has vollist ['468c66cc-effa-42af-b577-d99095c6964d'] >Thread-146::DEBUG::2012-11-29 11:10:39,916::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-146::DEBUG::2012-11-29 11:10:39,920::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-146::DEBUG::2012-11-29 11:10:39,923::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-146::DEBUG::2012-11-29 11:10:39,926::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >Thread-146::INFO::2012-11-29 11:10:39,929::image::344::Storage.Image::(getChain) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 imgUUID=66aec8c2-6186-4b29-a0ad-22137322f1ab chain=[<storage.fileVolume.FileVolume object at 0x7f5ab4470c10>] >Thread-146::DEBUG::2012-11-29 11:10:39,930::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`e25a36bf-cdd3-45c6-b560-738193f13519`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-146::DEBUG::2012-11-29 11:10:39,930::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-146::DEBUG::2012-11-29 11:10:39,931::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-146::DEBUG::2012-11-29 11:10:39,931::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`e25a36bf-cdd3-45c6-b560-738193f13519`::Granted request >Thread-146::DEBUG::2012-11-29 11:10:39,931::task::817::TaskManager.Task::(resourceAcquired) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-146::DEBUG::2012-11-29 11:10:39,932::task::978::TaskManager.Task::(_decref) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::ref 1 aborting False >Thread-146::DEBUG::2012-11-29 11:10:39,934::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >Thread-146::DEBUG::2012-11-29 11:10:39,942::taskManager::66::TaskManager::(scheduleJob) scheduled job copyImage_2cee16ba-639a-4980-8a42-9a667b3d2b48 for task 886d69ef-a3e1-4a67-abb7-793a57d9a887 >Thread-146::INFO::2012-11-29 11:10:39,943::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-146::DEBUG::2012-11-29 11:10:39,943::task::1167::TaskManager.Task::(prepare) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::Prepare: 1 jobs exist, move to acquiring >Thread-146::DEBUG::2012-11-29 11:10:39,943::task::588::TaskManager.Task::(_updateState) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::moving from state preparing -> state acquiring >Thread-146::DEBUG::2012-11-29 11:10:39,944::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >Thread-146::DEBUG::2012-11-29 11:10:39,955::task::588::TaskManager.Task::(_updateState) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::moving from state acquiring -> state queued >Thread-146::DEBUG::2012-11-29 11:10:39,956::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >Thread-146::DEBUG::2012-11-29 11:10:39,968::taskManager::48::TaskManager::(_queueTask) queueing task: 886d69ef-a3e1-4a67-abb7-793a57d9a887 >Thread-146::DEBUG::2012-11-29 11:10:39,968::taskManager::54::TaskManager::(_queueTask) task queued: 886d69ef-a3e1-4a67-abb7-793a57d9a887 >Thread-3::DEBUG::2012-11-29 11:10:39,968::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-146::DEBUG::2012-11-29 11:10:39,968::task::1169::TaskManager.Task::(prepare) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::returning >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,969::threadPool::212::Misc.ThreadPool.WorkerThread::(run) Task: 886d69ef-a3e1-4a67-abb7-793a57d9a887 running: <bound method Task.commit of <storage.task.Task instance at 0x7f5ab4473908>> with: None >Thread-146::DEBUG::2012-11-29 11:10:39,969::task::978::TaskManager.Task::(_decref) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::ref 0 aborting False >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,969::task::1181::TaskManager.Task::(commit) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::Commiting task: 886d69ef-a3e1-4a67-abb7-793a57d9a887 >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,970::task::588::TaskManager.Task::(_updateState) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::moving from state queued -> state running >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,971::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,982::task::892::TaskManager.Task::(_runJobs) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::Task.run: running job 0: copyImage_2cee16ba-639a-4980-8a42-9a667b3d2b48: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x12ada90>> (args: ('f1008a0c-010a-45a0-b80c-f5e8514a76e7', '', '66aec8c2-6186-4b29-a0ad-22137322f1ab', '468c66cc-effa-42af-b577-d99095c6964d', '2cee16ba-639a-4980-8a42-9a667b3d2b48', '0ecfa26d-1fc8-4ea7-994f-41f1b9529d53', 'Active VM', 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 6, 4, 2, False, False) kwargs: {}) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,982::task::317::TaskManager.Task::(run) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::Job.run: running copyImage_2cee16ba-639a-4980-8a42-9a667b3d2b48: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x12ada90>> (args: ('f1008a0c-010a-45a0-b80c-f5e8514a76e7', '', '66aec8c2-6186-4b29-a0ad-22137322f1ab', '468c66cc-effa-42af-b577-d99095c6964d', '2cee16ba-639a-4980-8a42-9a667b3d2b48', '0ecfa26d-1fc8-4ea7-994f-41f1b9529d53', 'Active VM', 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 6, 4, 2, False, False) kwargs: {}) callback None >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,982::resourceManager::175::ResourceManager.Request::(__init__) ResName=`f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab`ReqID=`5466c7ae-3bd8-4e02-9c7a-783d4902cd9e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,983::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' for lock type 'shared' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,985::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,987::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,990::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:39,993::image::344::Storage.Image::(getChain) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 imgUUID=66aec8c2-6186-4b29-a0ad-22137322f1ab chain=[<storage.fileVolume.FileVolume object at 0x7f5ab4470710>] >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,995::resourceManager::175::ResourceManager.Request::(__init__) ResName=`f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS.468c66cc-effa-42af-b577-d99095c6964d`ReqID=`551c9d1c-98b4-4812-a55b-8f9a542b1c2a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,995::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS.468c66cc-effa-42af-b577-d99095c6964d' for lock type 'shared' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,995::resourceManager::528::ResourceManager::(registerResource) Resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS.468c66cc-effa-42af-b577-d99095c6964d' is free. Now locking as 'shared' (1 active user) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,995::resourceManager::212::ResourceManager.Request::(grant) ResName=`f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS.468c66cc-effa-42af-b577-d99095c6964d`ReqID=`551c9d1c-98b4-4812-a55b-8f9a542b1c2a`::Granted request >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,996::resourceManager::528::ResourceManager::(registerResource) Resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' is free. Now locking as 'shared' (1 active user) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,996::resourceManager::212::ResourceManager.Request::(grant) ResName=`f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab`ReqID=`5466c7ae-3bd8-4e02-9c7a-783d4902cd9e`::Granted request >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,997::resourceManager::175::ResourceManager.Request::(__init__) ResName=`f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.2cee16ba-639a-4980-8a42-9a667b3d2b48`ReqID=`72beba0c-7bbc-4339-b82d-0bac77e15647`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,997::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.2cee16ba-639a-4980-8a42-9a667b3d2b48' for lock type 'exclusive' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,998::resourceFactories::119::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 2cee16ba-639a-4980-8a42-9a667b3d2b48 does not exist in domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,998::resourceManager::528::ResourceManager::(registerResource) Resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.2cee16ba-639a-4980-8a42-9a667b3d2b48' is free. Now locking as 'exclusive' (1 active user) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:39,999::resourceManager::212::ResourceManager.Request::(grant) ResName=`f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.2cee16ba-639a-4980-8a42-9a667b3d2b48`ReqID=`72beba0c-7bbc-4339-b82d-0bac77e15647`::Granted request >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:39,999::image::775::Storage.Image::(copy) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 vmUUID= srcImgUUID=66aec8c2-6186-4b29-a0ad-22137322f1ab srcVolUUID=468c66cc-effa-42af-b577-d99095c6964d dstImgUUID=2cee16ba-639a-4980-8a42-9a667b3d2b48 dstVolUUID=0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 dstSdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 volType=6 volFormat=COW preallocate=SPARSE force=False postZero=False >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,000::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 468c66cc-effa-42af-b577-d99095c6964d >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:40,011::image::820::Storage.Image::(copy) copy source f1008a0c-010a-45a0-b80c-f5e8514a76e7:66aec8c2-6186-4b29-a0ad-22137322f1ab:468c66cc-effa-42af-b577-d99095c6964d vol size 4194304 destination f1008a0c-010a-45a0-b80c-f5e8514a76e7:2cee16ba-639a-4980-8a42-9a667b3d2b48:0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 apparentsize 512 >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:40,011::image::457::Storage.Image::(isLegal) image 2cee16ba-639a-4980-8a42-9a667b3d2b48 in domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 has vollist [] >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:40,012::image::119::Storage.Image::(create) Create placeholder /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/2cee16ba-639a-4980-8a42-9a667b3d2b48 for image's volumes >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,012::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:40,027::volume::457::Storage.Volume::(create) Creating volume 0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,028::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,044::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:40,064::fileVolume::153::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 with size = 20480 sectors >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,065::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 10240K' (cwd None) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,073::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,117::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,140::fileVolume::401::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7, metaId=('/rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53',) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,161::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,179::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:40,184::volume::707::Storage.Volume::(prepare) Volume: preparing volume f1008a0c-010a-45a0-b80c-f5e8514a76e7/468c66cc-effa-42af-b577-d99095c6964d >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:40,187::volume::707::Storage.Volume::(prepare) Volume: preparing volume f1008a0c-010a-45a0-b80c-f5e8514a76e7/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,197::volume::1008::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d (qcow2) to /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 (qcow2) START >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,198::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d -O qcow2 /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53' (cwd None) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,202::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,718::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = []; <rc> = 0 >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,719::volume::1023::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/66aec8c2-6186-4b29-a0ad-22137322f1ab/468c66cc-effa-42af-b577-d99095c6964d to /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7/images/2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 DONE >886d69ef-a3e1-4a67-abb7-793a57d9a887::INFO::2012-11-29 11:10:40,722::image::888::Storage.Image::(copy) Finished copying f1008a0c-010a-45a0-b80c-f5e8514a76e7:468c66cc-effa-42af-b577-d99095c6964d -> f1008a0c-010a-45a0-b80c-f5e8514a76e7:0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,723::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.2cee16ba-639a-4980-8a42-9a667b3d2b48' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,723::resourceManager::553::ResourceManager::(releaseResource) Released resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.2cee16ba-639a-4980-8a42-9a667b3d2b48' (0 active users) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,723::resourceManager::558::ResourceManager::(releaseResource) Resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.2cee16ba-639a-4980-8a42-9a667b3d2b48' is free, finding out if anyone is waiting for it. >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,724::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.2cee16ba-639a-4980-8a42-9a667b3d2b48', Clearing records. >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,724::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,724::resourceManager::553::ResourceManager::(releaseResource) Released resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' (0 active users) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,725::resourceManager::558::ResourceManager::(releaseResource) Resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab' is free, finding out if anyone is waiting for it. >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,725::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS.468c66cc-effa-42af-b577-d99095c6964d' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,725::resourceManager::553::ResourceManager::(releaseResource) Released resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS.468c66cc-effa-42af-b577-d99095c6964d' (0 active users) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,726::resourceManager::558::ResourceManager::(releaseResource) Resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS.468c66cc-effa-42af-b577-d99095c6964d' is free, finding out if anyone is waiting for it. >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,726::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS.468c66cc-effa-42af-b577-d99095c6964d', Clearing records. >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,726::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS.66aec8c2-6186-4b29-a0ad-22137322f1ab', Clearing records. >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,727::task::588::TaskManager.Task::(_updateState) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::moving from state running -> state finished >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,727::task::740::TaskManager.Task::(_save) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/886d69ef-a3e1-4a67-abb7-793a57d9a887.temp >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,747::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,747::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,747::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,748::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,748::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,748::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,749::task::900::TaskManager.Task::(_runJobs) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::Task.run: exit - success: result {'uuid': '0ecfa26d-1fc8-4ea7-994f-41f1b9529d53'} >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,749::task::978::TaskManager.Task::(_decref) Task=`886d69ef-a3e1-4a67-abb7-793a57d9a887`::ref 0 aborting False >886d69ef-a3e1-4a67-abb7-793a57d9a887::DEBUG::2012-11-29 11:10:40,749::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-148::DEBUG::2012-11-29 11:10:41,129::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-148::DEBUG::2012-11-29 11:10:41,129::task::588::TaskManager.Task::(_updateState) Task=`b7582e89-2009-40af-a467-196b9e52c535`::moving from state init -> state preparing >Thread-148::INFO::2012-11-29 11:10:41,130::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-148::INFO::2012-11-29 11:10:41,130::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-148::DEBUG::2012-11-29 11:10:41,130::task::1172::TaskManager.Task::(prepare) Task=`b7582e89-2009-40af-a467-196b9e52c535`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-148::DEBUG::2012-11-29 11:10:41,131::task::588::TaskManager.Task::(_updateState) Task=`b7582e89-2009-40af-a467-196b9e52c535`::moving from state preparing -> state finished >Thread-148::DEBUG::2012-11-29 11:10:41,131::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-148::DEBUG::2012-11-29 11:10:41,131::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-148::DEBUG::2012-11-29 11:10:41,131::task::978::TaskManager.Task::(_decref) Task=`b7582e89-2009-40af-a467-196b9e52c535`::ref 0 aborting False >Thread-149::DEBUG::2012-11-29 11:10:41,166::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-149::DEBUG::2012-11-29 11:10:41,167::task::588::TaskManager.Task::(_updateState) Task=`0f5b98b7-b02c-4921-825d-d3eb51a208e7`::moving from state init -> state preparing >Thread-149::INFO::2012-11-29 11:10:41,167::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-149::DEBUG::2012-11-29 11:10:41,167::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`9d06cbc9-06c2-4c0b-b7f1-288a12954be8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-149::DEBUG::2012-11-29 11:10:41,168::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-149::DEBUG::2012-11-29 11:10:41,168::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-149::DEBUG::2012-11-29 11:10:41,168::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`9d06cbc9-06c2-4c0b-b7f1-288a12954be8`::Granted request >Thread-149::DEBUG::2012-11-29 11:10:41,169::task::817::TaskManager.Task::(resourceAcquired) Task=`0f5b98b7-b02c-4921-825d-d3eb51a208e7`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-149::DEBUG::2012-11-29 11:10:41,169::task::978::TaskManager.Task::(_decref) Task=`0f5b98b7-b02c-4921-825d-d3eb51a208e7`::ref 1 aborting False >Thread-149::INFO::2012-11-29 11:10:41,172::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862432788480'}}} >Thread-149::DEBUG::2012-11-29 11:10:41,172::task::1172::TaskManager.Task::(prepare) Task=`0f5b98b7-b02c-4921-825d-d3eb51a208e7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862432788480'}}} >Thread-149::DEBUG::2012-11-29 11:10:41,172::task::588::TaskManager.Task::(_updateState) Task=`0f5b98b7-b02c-4921-825d-d3eb51a208e7`::moving from state preparing -> state finished >Thread-149::DEBUG::2012-11-29 11:10:41,173::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-149::DEBUG::2012-11-29 11:10:41,173::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-149::DEBUG::2012-11-29 11:10:41,173::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-149::DEBUG::2012-11-29 11:10:41,174::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-149::DEBUG::2012-11-29 11:10:41,174::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-149::DEBUG::2012-11-29 11:10:41,174::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-149::DEBUG::2012-11-29 11:10:41,174::task::978::TaskManager.Task::(_decref) Task=`0f5b98b7-b02c-4921-825d-d3eb51a208e7`::ref 0 aborting False >Thread-153::DEBUG::2012-11-29 11:10:48,095::task::588::TaskManager.Task::(_updateState) Task=`1d7a7a83-116c-44dc-89d9-8ddb9355af85`::moving from state init -> state preparing >Thread-153::INFO::2012-11-29 11:10:48,095::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-153::INFO::2012-11-29 11:10:48,096::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00157499313354', 'lastCheck': '3.2', 'code': 0, 'valid': True}} >Thread-153::DEBUG::2012-11-29 11:10:48,096::task::1172::TaskManager.Task::(prepare) Task=`1d7a7a83-116c-44dc-89d9-8ddb9355af85`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00157499313354', 'lastCheck': '3.2', 'code': 0, 'valid': True}} >Thread-153::DEBUG::2012-11-29 11:10:48,096::task::588::TaskManager.Task::(_updateState) Task=`1d7a7a83-116c-44dc-89d9-8ddb9355af85`::moving from state preparing -> state finished >Thread-153::DEBUG::2012-11-29 11:10:48,097::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-153::DEBUG::2012-11-29 11:10:48,097::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-153::DEBUG::2012-11-29 11:10:48,097::task::978::TaskManager.Task::(_decref) Task=`1d7a7a83-116c-44dc-89d9-8ddb9355af85`::ref 0 aborting False >Thread-155::DEBUG::2012-11-29 11:10:49,955::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-155::DEBUG::2012-11-29 11:10:49,956::task::588::TaskManager.Task::(_updateState) Task=`ef7fa677-810a-44f2-a09d-a35fd29c605e`::moving from state init -> state preparing >Thread-155::INFO::2012-11-29 11:10:49,956::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-155::DEBUG::2012-11-29 11:10:49,957::taskManager::103::TaskManager::(getAllTasksStatuses) Entry. >Thread-155::DEBUG::2012-11-29 11:10:49,957::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 886d69ef-a3e1-4a67-abb7-793a57d9a887 >Thread-155::DEBUG::2012-11-29 11:10:49,957::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '886d69ef-a3e1-4a67-abb7-793a57d9a887'} >Thread-155::DEBUG::2012-11-29 11:10:49,957::taskManager::112::TaskManager::(getAllTasksStatuses) Return: {'886d69ef-a3e1-4a67-abb7-793a57d9a887': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '886d69ef-a3e1-4a67-abb7-793a57d9a887'}} >Thread-155::INFO::2012-11-29 11:10:49,958::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'886d69ef-a3e1-4a67-abb7-793a57d9a887': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '886d69ef-a3e1-4a67-abb7-793a57d9a887'}}} >Thread-155::DEBUG::2012-11-29 11:10:49,958::task::1172::TaskManager.Task::(prepare) Task=`ef7fa677-810a-44f2-a09d-a35fd29c605e`::finished: {'allTasksStatus': {'886d69ef-a3e1-4a67-abb7-793a57d9a887': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '886d69ef-a3e1-4a67-abb7-793a57d9a887'}}} >Thread-155::DEBUG::2012-11-29 11:10:49,958::task::588::TaskManager.Task::(_updateState) Task=`ef7fa677-810a-44f2-a09d-a35fd29c605e`::moving from state preparing -> state finished >Thread-155::DEBUG::2012-11-29 11:10:49,959::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2012-11-29 11:10:49,959::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2012-11-29 11:10:49,959::task::978::TaskManager.Task::(_decref) Task=`ef7fa677-810a-44f2-a09d-a35fd29c605e`::ref 0 aborting False >Thread-156::DEBUG::2012-11-29 11:10:50,038::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-156::DEBUG::2012-11-29 11:10:50,039::task::588::TaskManager.Task::(_updateState) Task=`4e0b2bf2-9bb7-41f0-b06d-1282e86fc846`::moving from state init -> state preparing >Thread-156::INFO::2012-11-29 11:10:50,039::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', imgUUID='2cee16ba-639a-4980-8a42-9a667b3d2b48', volUUID='0ecfa26d-1fc8-4ea7-994f-41f1b9529d53', options=None) >Thread-156::DEBUG::2012-11-29 11:10:50,039::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`feaf6e62-33cc-4af9-9846-a396559a8810`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-156::DEBUG::2012-11-29 11:10:50,040::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-156::DEBUG::2012-11-29 11:10:50,040::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-156::DEBUG::2012-11-29 11:10:50,040::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`feaf6e62-33cc-4af9-9846-a396559a8810`::Granted request >Thread-156::DEBUG::2012-11-29 11:10:50,041::task::817::TaskManager.Task::(resourceAcquired) Task=`4e0b2bf2-9bb7-41f0-b06d-1282e86fc846`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-156::DEBUG::2012-11-29 11:10:50,041::task::978::TaskManager.Task::(_decref) Task=`4e0b2bf2-9bb7-41f0-b06d-1282e86fc846`::ref 1 aborting False >Thread-156::DEBUG::2012-11-29 11:10:50,043::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 >Thread-156::INFO::2012-11-29 11:10:50,044::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 imgUUID=2cee16ba-639a-4980-8a42-9a667b3d2b48 volUUID = 0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 >Thread-156::DEBUG::2012-11-29 11:10:50,052::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 >Thread-156::DEBUG::2012-11-29 11:10:50,055::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 >Thread-156::INFO::2012-11-29 11:10:50,057::volume::824::Storage.Volume::(getInfo) f1008a0c-010a-45a0-b80c-f5e8514a76e7/2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53 info is {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2cee16ba-639a-4980-8a42-9a667b3d2b48', 'ctime': '1354180240', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180240', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '0ecfa26d-1fc8-4ea7-994f-41f1b9529d53', 'truesize': '512', 'type': 'SPARSE'} >Thread-156::INFO::2012-11-29 11:10:50,057::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2cee16ba-639a-4980-8a42-9a667b3d2b48', 'ctime': '1354180240', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180240', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '0ecfa26d-1fc8-4ea7-994f-41f1b9529d53', 'truesize': '512', 'type': 'SPARSE'}} >Thread-156::DEBUG::2012-11-29 11:10:50,057::task::1172::TaskManager.Task::(prepare) Task=`4e0b2bf2-9bb7-41f0-b06d-1282e86fc846`::finished: {'info': {'status': 'OK', 'domain': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '2cee16ba-639a-4980-8a42-9a667b3d2b48', 'ctime': '1354180240', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354180240', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '0ecfa26d-1fc8-4ea7-994f-41f1b9529d53', 'truesize': '512', 'type': 'SPARSE'}} >Thread-156::DEBUG::2012-11-29 11:10:50,058::task::588::TaskManager.Task::(_updateState) Task=`4e0b2bf2-9bb7-41f0-b06d-1282e86fc846`::moving from state preparing -> state finished >Thread-156::DEBUG::2012-11-29 11:10:50,058::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-156::DEBUG::2012-11-29 11:10:50,058::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-156::DEBUG::2012-11-29 11:10:50,058::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-156::DEBUG::2012-11-29 11:10:50,059::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-156::DEBUG::2012-11-29 11:10:50,059::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-156::DEBUG::2012-11-29 11:10:50,059::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-156::DEBUG::2012-11-29 11:10:50,060::task::978::TaskManager.Task::(_decref) Task=`4e0b2bf2-9bb7-41f0-b06d-1282e86fc846`::ref 0 aborting False >Thread-157::DEBUG::2012-11-29 11:10:50,153::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-157::DEBUG::2012-11-29 11:10:50,153::task::588::TaskManager.Task::(_updateState) Task=`62cbc406-f5ab-4fe6-8305-4451c1a0c4d6`::moving from state init -> state preparing >Thread-157::INFO::2012-11-29 11:10:50,154::logUtils::37::dispatcher::(wrapper) Run and protect: updateVM(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', vmList=[{'imglist': '2cee16ba-639a-4980-8a42-9a667b3d2b48', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.1.0.0"><References><File ovf:href="2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53" ovf:id="0ecfa26d-1fc8-4ea7-994f-41f1b9529d53" ovf:size="2147483648" ovf:description=""/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="0ecfa26d-1fc8-4ea7-994f-41f1b9529d53" ovf:size="2" ovf:actual_size="0" ovf:vm_snapshot_id="151fdb6a-3c3d-406b-a880-d0f720de59d1" ovf:parentRef="" ovf:fileRef="2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="IDE" ovf:boot="false" ovf:disk-alias="restvm_templates_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Name>rest_templ3</Name><TemplateId>1697412a-5b5f-458e-9895-0e38d912cea5</TemplateId><Description></Description><Domain></Domain><CreationDate>2012/11/29 09:10:39</CreationDate><ExportDate>2012/11/29 09:10:50</ExportDate><IsAutoSuspend>false</IsAutoSuspend><TimeZone></TimeZone><Origin>0</Origin><VmType>0</VmType><default_display_type>1</default_display_type><default_boot_sequence>0</default_boot_sequence><Section ovf:id="1697412a-5b5f-458e-9895-0e38d912cea5" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>Unassigned</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.1.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>restvm_templates_Disk1</rasd:Caption><rasd:InstanceId>0ecfa26d-1fc8-4ea7-994f-41f1b9529d53</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>2cee16ba-639a-4980-8a42-9a667b3d2b48/0ecfa26d-1fc8-4ea7-994f-41f1b9529d53</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>f1008a0c-010a-45a0-b80c-f5e8514a76e7</rasd:StorageId><rasd:StoragePoolId>21ea8081-3262-478a-8e4a-8e46b0e2fbc9</rasd:StoragePoolId><rasd:CreationDate>2012/11/29 09:10:40</rasd:CreationDate><rasd:LastModified>2012/11/29 09:10:40</rasd:LastModified></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>\n', 'vm': '1697412a-5b5f-458e-9895-0e38d912cea5'}], sdUUID=None, options=None) >Thread-157::DEBUG::2012-11-29 11:10:50,154::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`b29ecb34-c3a0-4a66-8e62-5ae3da77a3cf`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-157::DEBUG::2012-11-29 11:10:50,154::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-157::DEBUG::2012-11-29 11:10:50,155::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-157::DEBUG::2012-11-29 11:10:50,155::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`b29ecb34-c3a0-4a66-8e62-5ae3da77a3cf`::Granted request >Thread-157::DEBUG::2012-11-29 11:10:50,156::task::817::TaskManager.Task::(resourceAcquired) Task=`62cbc406-f5ab-4fe6-8305-4451c1a0c4d6`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-157::DEBUG::2012-11-29 11:10:50,156::task::978::TaskManager.Task::(_decref) Task=`62cbc406-f5ab-4fe6-8305-4451c1a0c4d6`::ref 1 aborting False >Thread-157::INFO::2012-11-29 11:10:50,156::sp::1262::Storage.StoragePool::(updateVM) spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-157::INFO::2012-11-29 11:10:50,157::sp::1273::Storage.StoragePool::(updateVM) vmUUID=1697412a-5b5f-458e-9895-0e38d912cea5 imgList=['2cee16ba-639a-4980-8a42-9a667b3d2b48'] >Thread-157::INFO::2012-11-29 11:10:50,160::logUtils::39::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-157::DEBUG::2012-11-29 11:10:50,160::task::1172::TaskManager.Task::(prepare) Task=`62cbc406-f5ab-4fe6-8305-4451c1a0c4d6`::finished: None >Thread-157::DEBUG::2012-11-29 11:10:50,161::task::588::TaskManager.Task::(_updateState) Task=`62cbc406-f5ab-4fe6-8305-4451c1a0c4d6`::moving from state preparing -> state finished >Thread-157::DEBUG::2012-11-29 11:10:50,161::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-157::DEBUG::2012-11-29 11:10:50,161::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-157::DEBUG::2012-11-29 11:10:50,162::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-157::DEBUG::2012-11-29 11:10:50,162::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-157::DEBUG::2012-11-29 11:10:50,162::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-157::DEBUG::2012-11-29 11:10:50,162::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-157::DEBUG::2012-11-29 11:10:50,163::task::978::TaskManager.Task::(_decref) Task=`62cbc406-f5ab-4fe6-8305-4451c1a0c4d6`::ref 0 aborting False >Thread-159::DEBUG::2012-11-29 11:10:50,230::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-159::DEBUG::2012-11-29 11:10:50,230::task::588::TaskManager.Task::(_updateState) Task=`4355724e-e809-4ea3-9a2c-9c9ac0389b46`::moving from state init -> state preparing >Thread-159::INFO::2012-11-29 11:10:50,231::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='886d69ef-a3e1-4a67-abb7-793a57d9a887', spUUID=None, options=None) >Thread-159::DEBUG::2012-11-29 11:10:50,231::taskManager::161::TaskManager::(clearTask) Entry. taskID: 886d69ef-a3e1-4a67-abb7-793a57d9a887 >Thread-159::DEBUG::2012-11-29 11:10:50,237::taskManager::166::TaskManager::(clearTask) Return. >Thread-159::INFO::2012-11-29 11:10:50,237::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-159::DEBUG::2012-11-29 11:10:50,237::task::1172::TaskManager.Task::(prepare) Task=`4355724e-e809-4ea3-9a2c-9c9ac0389b46`::finished: None >Thread-159::DEBUG::2012-11-29 11:10:50,237::task::588::TaskManager.Task::(_updateState) Task=`4355724e-e809-4ea3-9a2c-9c9ac0389b46`::moving from state preparing -> state finished >Thread-159::DEBUG::2012-11-29 11:10:50,238::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-159::DEBUG::2012-11-29 11:10:50,238::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-159::DEBUG::2012-11-29 11:10:50,238::task::978::TaskManager.Task::(_decref) Task=`4355724e-e809-4ea3-9a2c-9c9ac0389b46`::ref 0 aborting False >Thread-160::DEBUG::2012-11-29 11:10:51,285::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-160::DEBUG::2012-11-29 11:10:51,285::task::588::TaskManager.Task::(_updateState) Task=`2591db9b-6660-4270-97a1-0ecfc9ed34db`::moving from state init -> state preparing >Thread-160::INFO::2012-11-29 11:10:51,285::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-160::INFO::2012-11-29 11:10:51,286::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-160::DEBUG::2012-11-29 11:10:51,286::task::1172::TaskManager.Task::(prepare) Task=`2591db9b-6660-4270-97a1-0ecfc9ed34db`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-160::DEBUG::2012-11-29 11:10:51,286::task::588::TaskManager.Task::(_updateState) Task=`2591db9b-6660-4270-97a1-0ecfc9ed34db`::moving from state preparing -> state finished >Thread-160::DEBUG::2012-11-29 11:10:51,287::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-160::DEBUG::2012-11-29 11:10:51,287::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-160::DEBUG::2012-11-29 11:10:51,287::task::978::TaskManager.Task::(_decref) Task=`2591db9b-6660-4270-97a1-0ecfc9ed34db`::ref 0 aborting False >Thread-161::DEBUG::2012-11-29 11:10:51,325::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-161::DEBUG::2012-11-29 11:10:51,325::task::588::TaskManager.Task::(_updateState) Task=`9b58e63a-d0f7-4051-8332-ead2dea699d8`::moving from state init -> state preparing >Thread-161::INFO::2012-11-29 11:10:51,326::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-161::DEBUG::2012-11-29 11:10:51,326::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`453c18d8-c0a7-4697-8003-41973e966698`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-161::DEBUG::2012-11-29 11:10:51,327::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-161::DEBUG::2012-11-29 11:10:51,327::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-161::DEBUG::2012-11-29 11:10:51,327::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`453c18d8-c0a7-4697-8003-41973e966698`::Granted request >Thread-161::DEBUG::2012-11-29 11:10:51,328::task::817::TaskManager.Task::(resourceAcquired) Task=`9b58e63a-d0f7-4051-8332-ead2dea699d8`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-161::DEBUG::2012-11-29 11:10:51,328::task::978::TaskManager.Task::(_decref) Task=`9b58e63a-d0f7-4051-8332-ead2dea699d8`::ref 1 aborting False >Thread-161::INFO::2012-11-29 11:10:51,330::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862432788480'}}} >Thread-161::DEBUG::2012-11-29 11:10:51,331::task::1172::TaskManager.Task::(prepare) Task=`9b58e63a-d0f7-4051-8332-ead2dea699d8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862432788480'}}} >Thread-161::DEBUG::2012-11-29 11:10:51,331::task::588::TaskManager.Task::(_updateState) Task=`9b58e63a-d0f7-4051-8332-ead2dea699d8`::moving from state preparing -> state finished >Thread-161::DEBUG::2012-11-29 11:10:51,331::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-161::DEBUG::2012-11-29 11:10:51,332::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2012-11-29 11:10:51,332::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-161::DEBUG::2012-11-29 11:10:51,332::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-161::DEBUG::2012-11-29 11:10:51,333::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-161::DEBUG::2012-11-29 11:10:51,333::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-161::DEBUG::2012-11-29 11:10:51,333::task::978::TaskManager.Task::(_decref) Task=`9b58e63a-d0f7-4051-8332-ead2dea699d8`::ref 0 aborting False >Thread-165::DEBUG::2012-11-29 11:10:58,367::task::588::TaskManager.Task::(_updateState) Task=`d59e3c7d-435c-460c-8e8e-0e27a869b6fd`::moving from state init -> state preparing >Thread-165::INFO::2012-11-29 11:10:58,368::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-165::INFO::2012-11-29 11:10:58,368::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00130081176758', 'lastCheck': '3.5', 'code': 0, 'valid': True}} >Thread-165::DEBUG::2012-11-29 11:10:58,369::task::1172::TaskManager.Task::(prepare) Task=`d59e3c7d-435c-460c-8e8e-0e27a869b6fd`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00130081176758', 'lastCheck': '3.5', 'code': 0, 'valid': True}} >Thread-165::DEBUG::2012-11-29 11:10:58,369::task::588::TaskManager.Task::(_updateState) Task=`d59e3c7d-435c-460c-8e8e-0e27a869b6fd`::moving from state preparing -> state finished >Thread-165::DEBUG::2012-11-29 11:10:58,369::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-165::DEBUG::2012-11-29 11:10:58,369::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-165::DEBUG::2012-11-29 11:10:58,370::task::978::TaskManager.Task::(_decref) Task=`d59e3c7d-435c-460c-8e8e-0e27a869b6fd`::ref 0 aborting False >Thread-168::DEBUG::2012-11-29 11:11:01,403::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-168::DEBUG::2012-11-29 11:11:01,403::task::588::TaskManager.Task::(_updateState) Task=`2f088d64-66a5-4b9e-aa1c-473526437945`::moving from state init -> state preparing >Thread-168::INFO::2012-11-29 11:11:01,404::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-168::INFO::2012-11-29 11:11:01,404::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-168::DEBUG::2012-11-29 11:11:01,404::task::1172::TaskManager.Task::(prepare) Task=`2f088d64-66a5-4b9e-aa1c-473526437945`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-168::DEBUG::2012-11-29 11:11:01,405::task::588::TaskManager.Task::(_updateState) Task=`2f088d64-66a5-4b9e-aa1c-473526437945`::moving from state preparing -> state finished >Thread-168::DEBUG::2012-11-29 11:11:01,405::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-168::DEBUG::2012-11-29 11:11:01,405::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-168::DEBUG::2012-11-29 11:11:01,406::task::978::TaskManager.Task::(_decref) Task=`2f088d64-66a5-4b9e-aa1c-473526437945`::ref 0 aborting False >Thread-169::DEBUG::2012-11-29 11:11:01,433::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-169::DEBUG::2012-11-29 11:11:01,434::task::588::TaskManager.Task::(_updateState) Task=`95ea1407-5b98-4066-805b-db1775314ab7`::moving from state init -> state preparing >Thread-169::INFO::2012-11-29 11:11:01,434::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-169::DEBUG::2012-11-29 11:11:01,435::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`f7c8b815-bedc-4002-ab0d-d63dcad0ecde`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-169::DEBUG::2012-11-29 11:11:01,435::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-169::DEBUG::2012-11-29 11:11:01,435::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-169::DEBUG::2012-11-29 11:11:01,436::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`f7c8b815-bedc-4002-ab0d-d63dcad0ecde`::Granted request >Thread-169::DEBUG::2012-11-29 11:11:01,436::task::817::TaskManager.Task::(resourceAcquired) Task=`95ea1407-5b98-4066-805b-db1775314ab7`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-169::DEBUG::2012-11-29 11:11:01,436::task::978::TaskManager.Task::(_decref) Task=`95ea1407-5b98-4066-805b-db1775314ab7`::ref 1 aborting False >Thread-169::INFO::2012-11-29 11:11:01,439::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862432788480'}}} >Thread-169::DEBUG::2012-11-29 11:11:01,439::task::1172::TaskManager.Task::(prepare) Task=`95ea1407-5b98-4066-805b-db1775314ab7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862432788480'}}} >Thread-169::DEBUG::2012-11-29 11:11:01,440::task::588::TaskManager.Task::(_updateState) Task=`95ea1407-5b98-4066-805b-db1775314ab7`::moving from state preparing -> state finished >Thread-169::DEBUG::2012-11-29 11:11:01,440::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-169::DEBUG::2012-11-29 11:11:01,440::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-169::DEBUG::2012-11-29 11:11:01,441::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-169::DEBUG::2012-11-29 11:11:01,441::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-169::DEBUG::2012-11-29 11:11:01,441::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-169::DEBUG::2012-11-29 11:11:01,441::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-169::DEBUG::2012-11-29 11:11:01,442::task::978::TaskManager.Task::(_decref) Task=`95ea1407-5b98-4066-805b-db1775314ab7`::ref 0 aborting False >Thread-173::DEBUG::2012-11-29 11:11:08,638::task::588::TaskManager.Task::(_updateState) Task=`54c8e036-2a84-43c8-bf67-b68a90f2b60e`::moving from state init -> state preparing >Thread-173::INFO::2012-11-29 11:11:08,638::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-173::INFO::2012-11-29 11:11:08,638::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00136685371399', 'lastCheck': '3.7', 'code': 0, 'valid': True}} >Thread-173::DEBUG::2012-11-29 11:11:08,639::task::1172::TaskManager.Task::(prepare) Task=`54c8e036-2a84-43c8-bf67-b68a90f2b60e`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00136685371399', 'lastCheck': '3.7', 'code': 0, 'valid': True}} >Thread-173::DEBUG::2012-11-29 11:11:08,639::task::588::TaskManager.Task::(_updateState) Task=`54c8e036-2a84-43c8-bf67-b68a90f2b60e`::moving from state preparing -> state finished >Thread-173::DEBUG::2012-11-29 11:11:08,639::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-173::DEBUG::2012-11-29 11:11:08,640::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-173::DEBUG::2012-11-29 11:11:08,640::task::978::TaskManager.Task::(_decref) Task=`54c8e036-2a84-43c8-bf67-b68a90f2b60e`::ref 0 aborting False >Thread-176::DEBUG::2012-11-29 11:11:11,498::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-176::DEBUG::2012-11-29 11:11:11,499::task::588::TaskManager.Task::(_updateState) Task=`7aacdb02-34e9-4e30-b7a9-68851f39e239`::moving from state init -> state preparing >Thread-176::INFO::2012-11-29 11:11:11,499::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-176::INFO::2012-11-29 11:11:11,499::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-176::DEBUG::2012-11-29 11:11:11,499::task::1172::TaskManager.Task::(prepare) Task=`7aacdb02-34e9-4e30-b7a9-68851f39e239`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-176::DEBUG::2012-11-29 11:11:11,500::task::588::TaskManager.Task::(_updateState) Task=`7aacdb02-34e9-4e30-b7a9-68851f39e239`::moving from state preparing -> state finished >Thread-176::DEBUG::2012-11-29 11:11:11,500::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-176::DEBUG::2012-11-29 11:11:11,500::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-176::DEBUG::2012-11-29 11:11:11,501::task::978::TaskManager.Task::(_decref) Task=`7aacdb02-34e9-4e30-b7a9-68851f39e239`::ref 0 aborting False >Thread-177::DEBUG::2012-11-29 11:11:11,544::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-177::DEBUG::2012-11-29 11:11:11,544::task::588::TaskManager.Task::(_updateState) Task=`ac8cd16b-c449-47b8-8074-daee405883ad`::moving from state init -> state preparing >Thread-177::INFO::2012-11-29 11:11:11,545::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-177::DEBUG::2012-11-29 11:11:11,545::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`c28f20ec-5812-4906-a37d-cad150683df1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-177::DEBUG::2012-11-29 11:11:11,545::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-177::DEBUG::2012-11-29 11:11:11,546::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-177::DEBUG::2012-11-29 11:11:11,546::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`c28f20ec-5812-4906-a37d-cad150683df1`::Granted request >Thread-177::DEBUG::2012-11-29 11:11:11,546::task::817::TaskManager.Task::(resourceAcquired) Task=`ac8cd16b-c449-47b8-8074-daee405883ad`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-177::DEBUG::2012-11-29 11:11:11,547::task::978::TaskManager.Task::(_decref) Task=`ac8cd16b-c449-47b8-8074-daee405883ad`::ref 1 aborting False >Thread-177::INFO::2012-11-29 11:11:11,549::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-177::DEBUG::2012-11-29 11:11:11,550::task::1172::TaskManager.Task::(prepare) Task=`ac8cd16b-c449-47b8-8074-daee405883ad`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-177::DEBUG::2012-11-29 11:11:11,550::task::588::TaskManager.Task::(_updateState) Task=`ac8cd16b-c449-47b8-8074-daee405883ad`::moving from state preparing -> state finished >Thread-177::DEBUG::2012-11-29 11:11:11,550::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-177::DEBUG::2012-11-29 11:11:11,550::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-177::DEBUG::2012-11-29 11:11:11,551::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-177::DEBUG::2012-11-29 11:11:11,551::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-177::DEBUG::2012-11-29 11:11:11,551::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-177::DEBUG::2012-11-29 11:11:11,552::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-177::DEBUG::2012-11-29 11:11:11,552::task::978::TaskManager.Task::(_decref) Task=`ac8cd16b-c449-47b8-8074-daee405883ad`::ref 0 aborting False >Thread-181::DEBUG::2012-11-29 11:11:18,911::task::588::TaskManager.Task::(_updateState) Task=`cdf85486-032f-4ca7-8210-7c5f7838e591`::moving from state init -> state preparing >Thread-181::INFO::2012-11-29 11:11:18,912::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-181::INFO::2012-11-29 11:11:18,912::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00128197669983', 'lastCheck': '4.0', 'code': 0, 'valid': True}} >Thread-181::DEBUG::2012-11-29 11:11:18,912::task::1172::TaskManager.Task::(prepare) Task=`cdf85486-032f-4ca7-8210-7c5f7838e591`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00128197669983', 'lastCheck': '4.0', 'code': 0, 'valid': True}} >Thread-181::DEBUG::2012-11-29 11:11:18,912::task::588::TaskManager.Task::(_updateState) Task=`cdf85486-032f-4ca7-8210-7c5f7838e591`::moving from state preparing -> state finished >Thread-181::DEBUG::2012-11-29 11:11:18,913::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-181::DEBUG::2012-11-29 11:11:18,913::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-181::DEBUG::2012-11-29 11:11:18,913::task::978::TaskManager.Task::(_decref) Task=`cdf85486-032f-4ca7-8210-7c5f7838e591`::ref 0 aborting False >Thread-184::DEBUG::2012-11-29 11:11:21,615::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-184::DEBUG::2012-11-29 11:11:21,615::task::588::TaskManager.Task::(_updateState) Task=`efe3a5fb-9c08-47ac-8f15-556e9bd9ee9a`::moving from state init -> state preparing >Thread-184::INFO::2012-11-29 11:11:21,616::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-184::INFO::2012-11-29 11:11:21,616::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-184::DEBUG::2012-11-29 11:11:21,616::task::1172::TaskManager.Task::(prepare) Task=`efe3a5fb-9c08-47ac-8f15-556e9bd9ee9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-184::DEBUG::2012-11-29 11:11:21,617::task::588::TaskManager.Task::(_updateState) Task=`efe3a5fb-9c08-47ac-8f15-556e9bd9ee9a`::moving from state preparing -> state finished >Thread-184::DEBUG::2012-11-29 11:11:21,617::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184::DEBUG::2012-11-29 11:11:21,617::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184::DEBUG::2012-11-29 11:11:21,617::task::978::TaskManager.Task::(_decref) Task=`efe3a5fb-9c08-47ac-8f15-556e9bd9ee9a`::ref 0 aborting False >Thread-185::DEBUG::2012-11-29 11:11:21,662::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-185::DEBUG::2012-11-29 11:11:21,663::task::588::TaskManager.Task::(_updateState) Task=`0b9e7a9f-e11b-45e9-8386-09f33dce6830`::moving from state init -> state preparing >Thread-185::INFO::2012-11-29 11:11:21,663::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-185::DEBUG::2012-11-29 11:11:21,663::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`efa654f5-ba13-4dd5-9b71-9d42c346556f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-185::DEBUG::2012-11-29 11:11:21,664::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-185::DEBUG::2012-11-29 11:11:21,664::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-185::DEBUG::2012-11-29 11:11:21,664::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`efa654f5-ba13-4dd5-9b71-9d42c346556f`::Granted request >Thread-185::DEBUG::2012-11-29 11:11:21,665::task::817::TaskManager.Task::(resourceAcquired) Task=`0b9e7a9f-e11b-45e9-8386-09f33dce6830`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-185::DEBUG::2012-11-29 11:11:21,665::task::978::TaskManager.Task::(_decref) Task=`0b9e7a9f-e11b-45e9-8386-09f33dce6830`::ref 1 aborting False >Thread-185::INFO::2012-11-29 11:11:21,667::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-185::DEBUG::2012-11-29 11:11:21,668::task::1172::TaskManager.Task::(prepare) Task=`0b9e7a9f-e11b-45e9-8386-09f33dce6830`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-185::DEBUG::2012-11-29 11:11:21,668::task::588::TaskManager.Task::(_updateState) Task=`0b9e7a9f-e11b-45e9-8386-09f33dce6830`::moving from state preparing -> state finished >Thread-185::DEBUG::2012-11-29 11:11:21,668::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-185::DEBUG::2012-11-29 11:11:21,669::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-185::DEBUG::2012-11-29 11:11:21,669::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-185::DEBUG::2012-11-29 11:11:21,669::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-185::DEBUG::2012-11-29 11:11:21,670::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-185::DEBUG::2012-11-29 11:11:21,670::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-185::DEBUG::2012-11-29 11:11:21,670::task::978::TaskManager.Task::(_decref) Task=`0b9e7a9f-e11b-45e9-8386-09f33dce6830`::ref 0 aborting False >Thread-189::DEBUG::2012-11-29 11:11:29,165::task::588::TaskManager.Task::(_updateState) Task=`967e9770-fc09-4736-b1f2-ce9d40efcd25`::moving from state init -> state preparing >Thread-189::INFO::2012-11-29 11:11:29,166::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-189::INFO::2012-11-29 11:11:29,166::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00140285491943', 'lastCheck': '4.2', 'code': 0, 'valid': True}} >Thread-189::DEBUG::2012-11-29 11:11:29,166::task::1172::TaskManager.Task::(prepare) Task=`967e9770-fc09-4736-b1f2-ce9d40efcd25`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00140285491943', 'lastCheck': '4.2', 'code': 0, 'valid': True}} >Thread-189::DEBUG::2012-11-29 11:11:29,166::task::588::TaskManager.Task::(_updateState) Task=`967e9770-fc09-4736-b1f2-ce9d40efcd25`::moving from state preparing -> state finished >Thread-189::DEBUG::2012-11-29 11:11:29,167::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189::DEBUG::2012-11-29 11:11:29,167::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189::DEBUG::2012-11-29 11:11:29,167::task::978::TaskManager.Task::(_decref) Task=`967e9770-fc09-4736-b1f2-ce9d40efcd25`::ref 0 aborting False >Thread-192::DEBUG::2012-11-29 11:11:31,722::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-192::DEBUG::2012-11-29 11:11:31,722::task::588::TaskManager.Task::(_updateState) Task=`2c1cd809-8b25-4dd4-8fe2-e3300b76846e`::moving from state init -> state preparing >Thread-192::INFO::2012-11-29 11:11:31,722::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-192::INFO::2012-11-29 11:11:31,723::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-192::DEBUG::2012-11-29 11:11:31,723::task::1172::TaskManager.Task::(prepare) Task=`2c1cd809-8b25-4dd4-8fe2-e3300b76846e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-192::DEBUG::2012-11-29 11:11:31,723::task::588::TaskManager.Task::(_updateState) Task=`2c1cd809-8b25-4dd4-8fe2-e3300b76846e`::moving from state preparing -> state finished >Thread-192::DEBUG::2012-11-29 11:11:31,724::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-192::DEBUG::2012-11-29 11:11:31,724::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-192::DEBUG::2012-11-29 11:11:31,724::task::978::TaskManager.Task::(_decref) Task=`2c1cd809-8b25-4dd4-8fe2-e3300b76846e`::ref 0 aborting False >Thread-193::DEBUG::2012-11-29 11:11:31,744::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-193::DEBUG::2012-11-29 11:11:31,745::task::588::TaskManager.Task::(_updateState) Task=`ba40fe87-3371-4b63-9323-2c90b6a7091e`::moving from state init -> state preparing >Thread-193::INFO::2012-11-29 11:11:31,745::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-193::DEBUG::2012-11-29 11:11:31,745::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`f6e74fcb-d36a-4a1d-bd1c-1c7e19db0583`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-193::DEBUG::2012-11-29 11:11:31,746::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-193::DEBUG::2012-11-29 11:11:31,746::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-193::DEBUG::2012-11-29 11:11:31,746::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`f6e74fcb-d36a-4a1d-bd1c-1c7e19db0583`::Granted request >Thread-193::DEBUG::2012-11-29 11:11:31,747::task::817::TaskManager.Task::(resourceAcquired) Task=`ba40fe87-3371-4b63-9323-2c90b6a7091e`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-193::DEBUG::2012-11-29 11:11:31,747::task::978::TaskManager.Task::(_decref) Task=`ba40fe87-3371-4b63-9323-2c90b6a7091e`::ref 1 aborting False >Thread-193::INFO::2012-11-29 11:11:31,749::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-193::DEBUG::2012-11-29 11:11:31,750::task::1172::TaskManager.Task::(prepare) Task=`ba40fe87-3371-4b63-9323-2c90b6a7091e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-193::DEBUG::2012-11-29 11:11:31,750::task::588::TaskManager.Task::(_updateState) Task=`ba40fe87-3371-4b63-9323-2c90b6a7091e`::moving from state preparing -> state finished >Thread-193::DEBUG::2012-11-29 11:11:31,750::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-193::DEBUG::2012-11-29 11:11:31,751::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-193::DEBUG::2012-11-29 11:11:31,751::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-193::DEBUG::2012-11-29 11:11:31,751::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-193::DEBUG::2012-11-29 11:11:31,752::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-193::DEBUG::2012-11-29 11:11:31,752::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-193::DEBUG::2012-11-29 11:11:31,752::task::978::TaskManager.Task::(_decref) Task=`ba40fe87-3371-4b63-9323-2c90b6a7091e`::ref 0 aborting False >Thread-197::DEBUG::2012-11-29 11:11:39,405::task::588::TaskManager.Task::(_updateState) Task=`92604db4-f48c-4ede-9fbf-62d5449c0a9e`::moving from state init -> state preparing >Thread-197::INFO::2012-11-29 11:11:39,406::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-197::INFO::2012-11-29 11:11:39,406::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00165510177612', 'lastCheck': '4.5', 'code': 0, 'valid': True}} >Thread-197::DEBUG::2012-11-29 11:11:39,406::task::1172::TaskManager.Task::(prepare) Task=`92604db4-f48c-4ede-9fbf-62d5449c0a9e`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00165510177612', 'lastCheck': '4.5', 'code': 0, 'valid': True}} >Thread-197::DEBUG::2012-11-29 11:11:39,406::task::588::TaskManager.Task::(_updateState) Task=`92604db4-f48c-4ede-9fbf-62d5449c0a9e`::moving from state preparing -> state finished >Thread-197::DEBUG::2012-11-29 11:11:39,407::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-197::DEBUG::2012-11-29 11:11:39,407::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-197::DEBUG::2012-11-29 11:11:39,407::task::978::TaskManager.Task::(_decref) Task=`92604db4-f48c-4ede-9fbf-62d5449c0a9e`::ref 0 aborting False >Thread-200::DEBUG::2012-11-29 11:11:41,818::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-200::DEBUG::2012-11-29 11:11:41,819::task::588::TaskManager.Task::(_updateState) Task=`00ab8241-5025-426e-818e-5b04bdc964e9`::moving from state init -> state preparing >Thread-200::INFO::2012-11-29 11:11:41,819::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-200::INFO::2012-11-29 11:11:41,819::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-200::DEBUG::2012-11-29 11:11:41,820::task::1172::TaskManager.Task::(prepare) Task=`00ab8241-5025-426e-818e-5b04bdc964e9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-200::DEBUG::2012-11-29 11:11:41,820::task::588::TaskManager.Task::(_updateState) Task=`00ab8241-5025-426e-818e-5b04bdc964e9`::moving from state preparing -> state finished >Thread-200::DEBUG::2012-11-29 11:11:41,820::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-200::DEBUG::2012-11-29 11:11:41,820::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-200::DEBUG::2012-11-29 11:11:41,821::task::978::TaskManager.Task::(_decref) Task=`00ab8241-5025-426e-818e-5b04bdc964e9`::ref 0 aborting False >Thread-201::DEBUG::2012-11-29 11:11:41,855::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-201::DEBUG::2012-11-29 11:11:41,855::task::588::TaskManager.Task::(_updateState) Task=`f9a44fdc-0c00-417c-9d0a-c21c197db4e7`::moving from state init -> state preparing >Thread-201::INFO::2012-11-29 11:11:41,856::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-201::DEBUG::2012-11-29 11:11:41,856::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`b0ffcfac-610c-4442-bdd3-5e2e26066d38`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-201::DEBUG::2012-11-29 11:11:41,857::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-201::DEBUG::2012-11-29 11:11:41,857::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-201::DEBUG::2012-11-29 11:11:41,857::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`b0ffcfac-610c-4442-bdd3-5e2e26066d38`::Granted request >Thread-201::DEBUG::2012-11-29 11:11:41,858::task::817::TaskManager.Task::(resourceAcquired) Task=`f9a44fdc-0c00-417c-9d0a-c21c197db4e7`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-201::DEBUG::2012-11-29 11:11:41,858::task::978::TaskManager.Task::(_decref) Task=`f9a44fdc-0c00-417c-9d0a-c21c197db4e7`::ref 1 aborting False >Thread-201::INFO::2012-11-29 11:11:41,860::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-201::DEBUG::2012-11-29 11:11:41,861::task::1172::TaskManager.Task::(prepare) Task=`f9a44fdc-0c00-417c-9d0a-c21c197db4e7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-201::DEBUG::2012-11-29 11:11:41,861::task::588::TaskManager.Task::(_updateState) Task=`f9a44fdc-0c00-417c-9d0a-c21c197db4e7`::moving from state preparing -> state finished >Thread-201::DEBUG::2012-11-29 11:11:41,861::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-201::DEBUG::2012-11-29 11:11:41,862::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-201::DEBUG::2012-11-29 11:11:41,862::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-201::DEBUG::2012-11-29 11:11:41,862::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-201::DEBUG::2012-11-29 11:11:41,863::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-201::DEBUG::2012-11-29 11:11:41,863::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-201::DEBUG::2012-11-29 11:11:41,863::task::978::TaskManager.Task::(_decref) Task=`f9a44fdc-0c00-417c-9d0a-c21c197db4e7`::ref 0 aborting False >Thread-205::DEBUG::2012-11-29 11:11:49,712::task::588::TaskManager.Task::(_updateState) Task=`5381ba39-71c0-4035-97dd-13b71ee27b8f`::moving from state init -> state preparing >Thread-205::INFO::2012-11-29 11:11:49,713::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-205::INFO::2012-11-29 11:11:49,713::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00115609169006', 'lastCheck': '4.8', 'code': 0, 'valid': True}} >Thread-205::DEBUG::2012-11-29 11:11:49,713::task::1172::TaskManager.Task::(prepare) Task=`5381ba39-71c0-4035-97dd-13b71ee27b8f`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00115609169006', 'lastCheck': '4.8', 'code': 0, 'valid': True}} >Thread-205::DEBUG::2012-11-29 11:11:49,714::task::588::TaskManager.Task::(_updateState) Task=`5381ba39-71c0-4035-97dd-13b71ee27b8f`::moving from state preparing -> state finished >Thread-205::DEBUG::2012-11-29 11:11:49,714::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-205::DEBUG::2012-11-29 11:11:49,714::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-205::DEBUG::2012-11-29 11:11:49,714::task::978::TaskManager.Task::(_decref) Task=`5381ba39-71c0-4035-97dd-13b71ee27b8f`::ref 0 aborting False >Thread-208::DEBUG::2012-11-29 11:11:51,895::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-208::DEBUG::2012-11-29 11:11:51,896::task::588::TaskManager.Task::(_updateState) Task=`57cc95ec-8e3a-4bc4-ad6a-1e78c513c1e5`::moving from state init -> state preparing >Thread-208::INFO::2012-11-29 11:11:51,896::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-208::INFO::2012-11-29 11:11:51,897::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-208::DEBUG::2012-11-29 11:11:51,897::task::1172::TaskManager.Task::(prepare) Task=`57cc95ec-8e3a-4bc4-ad6a-1e78c513c1e5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-208::DEBUG::2012-11-29 11:11:51,897::task::588::TaskManager.Task::(_updateState) Task=`57cc95ec-8e3a-4bc4-ad6a-1e78c513c1e5`::moving from state preparing -> state finished >Thread-208::DEBUG::2012-11-29 11:11:51,897::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-208::DEBUG::2012-11-29 11:11:51,898::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-208::DEBUG::2012-11-29 11:11:51,898::task::978::TaskManager.Task::(_decref) Task=`57cc95ec-8e3a-4bc4-ad6a-1e78c513c1e5`::ref 0 aborting False >Thread-209::DEBUG::2012-11-29 11:11:51,921::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-209::DEBUG::2012-11-29 11:11:51,921::task::588::TaskManager.Task::(_updateState) Task=`4fb6a2a9-e8a5-469b-99cf-349842ab38d7`::moving from state init -> state preparing >Thread-209::INFO::2012-11-29 11:11:51,921::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-209::DEBUG::2012-11-29 11:11:51,922::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`d69baca5-5f76-4603-a9d3-5814f901ea62`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-209::DEBUG::2012-11-29 11:11:51,922::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-209::DEBUG::2012-11-29 11:11:51,922::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-209::DEBUG::2012-11-29 11:11:51,923::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`d69baca5-5f76-4603-a9d3-5814f901ea62`::Granted request >Thread-209::DEBUG::2012-11-29 11:11:51,924::task::817::TaskManager.Task::(resourceAcquired) Task=`4fb6a2a9-e8a5-469b-99cf-349842ab38d7`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-209::DEBUG::2012-11-29 11:11:51,924::task::978::TaskManager.Task::(_decref) Task=`4fb6a2a9-e8a5-469b-99cf-349842ab38d7`::ref 1 aborting False >Thread-209::INFO::2012-11-29 11:11:51,926::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-209::DEBUG::2012-11-29 11:11:51,927::task::1172::TaskManager.Task::(prepare) Task=`4fb6a2a9-e8a5-469b-99cf-349842ab38d7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-209::DEBUG::2012-11-29 11:11:51,927::task::588::TaskManager.Task::(_updateState) Task=`4fb6a2a9-e8a5-469b-99cf-349842ab38d7`::moving from state preparing -> state finished >Thread-209::DEBUG::2012-11-29 11:11:51,927::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-209::DEBUG::2012-11-29 11:11:51,928::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-209::DEBUG::2012-11-29 11:11:51,928::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-209::DEBUG::2012-11-29 11:11:51,928::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-209::DEBUG::2012-11-29 11:11:51,929::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-209::DEBUG::2012-11-29 11:11:51,929::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-209::DEBUG::2012-11-29 11:11:51,929::task::978::TaskManager.Task::(_decref) Task=`4fb6a2a9-e8a5-469b-99cf-349842ab38d7`::ref 0 aborting False >Thread-213::DEBUG::2012-11-29 11:12:00,012::task::588::TaskManager.Task::(_updateState) Task=`136e8734-87e9-44c7-95a4-897299cba777`::moving from state init -> state preparing >Thread-213::INFO::2012-11-29 11:12:00,012::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-213::INFO::2012-11-29 11:12:00,012::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00114011764526', 'lastCheck': '5.1', 'code': 0, 'valid': True}} >Thread-213::DEBUG::2012-11-29 11:12:00,013::task::1172::TaskManager.Task::(prepare) Task=`136e8734-87e9-44c7-95a4-897299cba777`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00114011764526', 'lastCheck': '5.1', 'code': 0, 'valid': True}} >Thread-213::DEBUG::2012-11-29 11:12:00,013::task::588::TaskManager.Task::(_updateState) Task=`136e8734-87e9-44c7-95a4-897299cba777`::moving from state preparing -> state finished >Thread-213::DEBUG::2012-11-29 11:12:00,013::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-213::DEBUG::2012-11-29 11:12:00,013::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-213::DEBUG::2012-11-29 11:12:00,014::task::978::TaskManager.Task::(_decref) Task=`136e8734-87e9-44c7-95a4-897299cba777`::ref 0 aborting False >Thread-215::DEBUG::2012-11-29 11:12:01,967::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-215::DEBUG::2012-11-29 11:12:01,968::task::588::TaskManager.Task::(_updateState) Task=`0da87e29-1d44-4ead-995f-b0b5c66f267b`::moving from state init -> state preparing >Thread-215::INFO::2012-11-29 11:12:01,968::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-215::INFO::2012-11-29 11:12:01,968::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-215::DEBUG::2012-11-29 11:12:01,969::task::1172::TaskManager.Task::(prepare) Task=`0da87e29-1d44-4ead-995f-b0b5c66f267b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-215::DEBUG::2012-11-29 11:12:01,969::task::588::TaskManager.Task::(_updateState) Task=`0da87e29-1d44-4ead-995f-b0b5c66f267b`::moving from state preparing -> state finished >Thread-215::DEBUG::2012-11-29 11:12:01,969::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-215::DEBUG::2012-11-29 11:12:01,970::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-215::DEBUG::2012-11-29 11:12:01,970::task::978::TaskManager.Task::(_decref) Task=`0da87e29-1d44-4ead-995f-b0b5c66f267b`::ref 0 aborting False >Thread-216::DEBUG::2012-11-29 11:12:01,988::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-216::DEBUG::2012-11-29 11:12:01,988::task::588::TaskManager.Task::(_updateState) Task=`67844f73-304a-48b5-a8c6-df3bb9b3da2e`::moving from state init -> state preparing >Thread-216::INFO::2012-11-29 11:12:01,989::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-216::DEBUG::2012-11-29 11:12:01,989::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`6562c400-33c9-44fa-921a-bc649de03338`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-216::DEBUG::2012-11-29 11:12:01,990::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-216::DEBUG::2012-11-29 11:12:01,990::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-216::DEBUG::2012-11-29 11:12:01,990::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`6562c400-33c9-44fa-921a-bc649de03338`::Granted request >Thread-216::DEBUG::2012-11-29 11:12:01,991::task::817::TaskManager.Task::(resourceAcquired) Task=`67844f73-304a-48b5-a8c6-df3bb9b3da2e`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-216::DEBUG::2012-11-29 11:12:01,991::task::978::TaskManager.Task::(_decref) Task=`67844f73-304a-48b5-a8c6-df3bb9b3da2e`::ref 1 aborting False >Thread-216::INFO::2012-11-29 11:12:01,993::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-216::DEBUG::2012-11-29 11:12:01,994::task::1172::TaskManager.Task::(prepare) Task=`67844f73-304a-48b5-a8c6-df3bb9b3da2e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862433837056'}}} >Thread-216::DEBUG::2012-11-29 11:12:01,994::task::588::TaskManager.Task::(_updateState) Task=`67844f73-304a-48b5-a8c6-df3bb9b3da2e`::moving from state preparing -> state finished >Thread-216::DEBUG::2012-11-29 11:12:01,994::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-216::DEBUG::2012-11-29 11:12:01,995::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-216::DEBUG::2012-11-29 11:12:01,995::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-216::DEBUG::2012-11-29 11:12:01,995::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-216::DEBUG::2012-11-29 11:12:01,996::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-216::DEBUG::2012-11-29 11:12:01,996::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-216::DEBUG::2012-11-29 11:12:01,996::task::978::TaskManager.Task::(_decref) Task=`67844f73-304a-48b5-a8c6-df3bb9b3da2e`::ref 0 aborting False >Thread-221::DEBUG::2012-11-29 11:12:08,671::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-221::DEBUG::2012-11-29 11:12:08,672::task::588::TaskManager.Task::(_updateState) Task=`035d2a8f-e989-48c9-af0b-970e1a461a81`::moving from state init -> state preparing >Thread-221::INFO::2012-11-29 11:12:08,672::logUtils::37::dispatcher::(wrapper) Run and protect: removeVM(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', vmUUID='cc8ffeff-e6e9-4821-9b20-ba8383b776bd', sdUUID=None, options=None) >Thread-221::DEBUG::2012-11-29 11:12:08,672::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`158d9e70-6892-4fef-bcb0-e7be1bb5d352`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-221::DEBUG::2012-11-29 11:12:08,673::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-221::DEBUG::2012-11-29 11:12:08,673::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-221::DEBUG::2012-11-29 11:12:08,673::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`158d9e70-6892-4fef-bcb0-e7be1bb5d352`::Granted request >Thread-221::DEBUG::2012-11-29 11:12:08,674::task::817::TaskManager.Task::(resourceAcquired) Task=`035d2a8f-e989-48c9-af0b-970e1a461a81`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-221::DEBUG::2012-11-29 11:12:08,674::task::978::TaskManager.Task::(_decref) Task=`035d2a8f-e989-48c9-af0b-970e1a461a81`::ref 1 aborting False >Thread-221::INFO::2012-11-29 11:12:08,674::sp::1300::Storage.StoragePool::(removeVM) spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 vmUUID=cc8ffeff-e6e9-4821-9b20-ba8383b776bd sdUUID=None >Thread-221::INFO::2012-11-29 11:12:08,675::logUtils::39::dispatcher::(wrapper) Run and protect: removeVM, Return response: None >Thread-221::DEBUG::2012-11-29 11:12:08,675::task::1172::TaskManager.Task::(prepare) Task=`035d2a8f-e989-48c9-af0b-970e1a461a81`::finished: None >Thread-221::DEBUG::2012-11-29 11:12:08,676::task::588::TaskManager.Task::(_updateState) Task=`035d2a8f-e989-48c9-af0b-970e1a461a81`::moving from state preparing -> state finished >Thread-221::DEBUG::2012-11-29 11:12:08,676::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-221::DEBUG::2012-11-29 11:12:08,676::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221::DEBUG::2012-11-29 11:12:08,677::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-221::DEBUG::2012-11-29 11:12:08,677::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-221::DEBUG::2012-11-29 11:12:08,677::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-221::DEBUG::2012-11-29 11:12:08,678::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-221::DEBUG::2012-11-29 11:12:08,678::task::978::TaskManager.Task::(_decref) Task=`035d2a8f-e989-48c9-af0b-970e1a461a81`::ref 0 aborting False >Thread-222::DEBUG::2012-11-29 11:12:08,852::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-222::DEBUG::2012-11-29 11:12:08,852::task::588::TaskManager.Task::(_updateState) Task=`d88d509d-0990-415a-992f-db838726f57e`::moving from state init -> state preparing >Thread-222::INFO::2012-11-29 11:12:08,853::logUtils::37::dispatcher::(wrapper) Run and protect: removeVM(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', vmUUID='7c76ce48-a3a4-4410-8050-a6617c3f5e8b', sdUUID=None, options=None) >Thread-222::DEBUG::2012-11-29 11:12:08,853::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`fa746e6c-7c5f-4b11-8480-50a5945cf058`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-222::DEBUG::2012-11-29 11:12:08,853::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-222::DEBUG::2012-11-29 11:12:08,854::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-222::DEBUG::2012-11-29 11:12:08,854::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`fa746e6c-7c5f-4b11-8480-50a5945cf058`::Granted request >Thread-222::DEBUG::2012-11-29 11:12:08,855::task::817::TaskManager.Task::(resourceAcquired) Task=`d88d509d-0990-415a-992f-db838726f57e`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-222::DEBUG::2012-11-29 11:12:08,855::task::978::TaskManager.Task::(_decref) Task=`d88d509d-0990-415a-992f-db838726f57e`::ref 1 aborting False >Thread-222::INFO::2012-11-29 11:12:08,855::sp::1300::Storage.StoragePool::(removeVM) spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 vmUUID=7c76ce48-a3a4-4410-8050-a6617c3f5e8b sdUUID=None >Thread-222::INFO::2012-11-29 11:12:08,858::logUtils::39::dispatcher::(wrapper) Run and protect: removeVM, Return response: None >Thread-222::DEBUG::2012-11-29 11:12:08,858::task::1172::TaskManager.Task::(prepare) Task=`d88d509d-0990-415a-992f-db838726f57e`::finished: None >Thread-222::DEBUG::2012-11-29 11:12:08,858::task::588::TaskManager.Task::(_updateState) Task=`d88d509d-0990-415a-992f-db838726f57e`::moving from state preparing -> state finished >Thread-222::DEBUG::2012-11-29 11:12:08,859::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-222::DEBUG::2012-11-29 11:12:08,859::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-222::DEBUG::2012-11-29 11:12:08,859::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-222::DEBUG::2012-11-29 11:12:08,860::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-222::DEBUG::2012-11-29 11:12:08,860::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-222::DEBUG::2012-11-29 11:12:08,860::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-222::DEBUG::2012-11-29 11:12:08,861::task::978::TaskManager.Task::(_decref) Task=`d88d509d-0990-415a-992f-db838726f57e`::ref 0 aborting False >Thread-223::DEBUG::2012-11-29 11:12:08,986::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-223::DEBUG::2012-11-29 11:12:08,986::task::588::TaskManager.Task::(_updateState) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::moving from state init -> state preparing >Thread-223::INFO::2012-11-29 11:12:08,987::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', imgUUID='66aec8c2-6186-4b29-a0ad-22137322f1ab', postZero='false', force='false') >Thread-223::INFO::2012-11-29 11:12:08,987::fileSD::255::Storage.StorageDomain::(validate) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-223::DEBUG::2012-11-29 11:12:08,989::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c43d247ba3b2c5cfee7853bd064c721de3fe84ef'] >Thread-223::DEBUG::2012-11-29 11:12:08,990::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab`ReqID=`cfccee36-554c-45d5-a80c-d48bd5ecc999`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-223::DEBUG::2012-11-29 11:12:08,990::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab' for lock type 'exclusive' >Thread-223::DEBUG::2012-11-29 11:12:08,990::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab' is free. Now locking as 'exclusive' (1 active user) >Thread-223::DEBUG::2012-11-29 11:12:08,991::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab`ReqID=`cfccee36-554c-45d5-a80c-d48bd5ecc999`::Granted request >Thread-223::DEBUG::2012-11-29 11:12:08,991::task::817::TaskManager.Task::(resourceAcquired) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::_resourcesAcquired: Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab (exclusive) >Thread-223::DEBUG::2012-11-29 11:12:08,991::task::978::TaskManager.Task::(_decref) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::ref 1 aborting False >Thread-223::DEBUG::2012-11-29 11:12:08,992::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`38acd627-371d-4d0b-8bf8-d7c7dfd8b5c2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-223::DEBUG::2012-11-29 11:12:08,992::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-223::DEBUG::2012-11-29 11:12:08,992::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-223::DEBUG::2012-11-29 11:12:08,993::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`38acd627-371d-4d0b-8bf8-d7c7dfd8b5c2`::Granted request >Thread-223::DEBUG::2012-11-29 11:12:08,993::task::817::TaskManager.Task::(resourceAcquired) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-223::DEBUG::2012-11-29 11:12:08,993::task::978::TaskManager.Task::(_decref) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::ref 1 aborting False >Thread-223::DEBUG::2012-11-29 11:12:09,022::task::740::TaskManager.Task::(_save) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8.temp >Thread-223::DEBUG::2012-11-29 11:12:09,032::taskManager::66::TaskManager::(scheduleJob) scheduled job deleteImage_66aec8c2-6186-4b29-a0ad-22137322f1ab for task c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 >Thread-223::INFO::2012-11-29 11:12:09,032::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-223::DEBUG::2012-11-29 11:12:09,033::task::1167::TaskManager.Task::(prepare) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::Prepare: 1 jobs exist, move to acquiring >Thread-223::DEBUG::2012-11-29 11:12:09,033::task::588::TaskManager.Task::(_updateState) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::moving from state preparing -> state acquiring >Thread-223::DEBUG::2012-11-29 11:12:09,034::task::740::TaskManager.Task::(_save) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8.temp >Thread-223::DEBUG::2012-11-29 11:12:09,047::task::588::TaskManager.Task::(_updateState) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::moving from state acquiring -> state queued >Thread-223::DEBUG::2012-11-29 11:12:09,047::task::740::TaskManager.Task::(_save) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8.temp >Thread-223::DEBUG::2012-11-29 11:12:09,060::taskManager::48::TaskManager::(_queueTask) queueing task: c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 >Thread-223::DEBUG::2012-11-29 11:12:09,060::taskManager::54::TaskManager::(_queueTask) task queued: c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 >Thread-8::DEBUG::2012-11-29 11:12:09,060::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-223::DEBUG::2012-11-29 11:12:09,060::task::1169::TaskManager.Task::(prepare) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::returning >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,061::threadPool::212::Misc.ThreadPool.WorkerThread::(run) Task: c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 running: <bound method Task.commit of <storage.task.Task instance at 0x7f5ab4469d88>> with: None >Thread-223::DEBUG::2012-11-29 11:12:09,061::task::978::TaskManager.Task::(_decref) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::ref 0 aborting False >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,061::task::1181::TaskManager.Task::(commit) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::Commiting task: c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,062::task::588::TaskManager.Task::(_updateState) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::moving from state queued -> state running >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,063::task::740::TaskManager.Task::(_save) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8.temp >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,074::task::892::TaskManager.Task::(_runJobs) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::Task.run: running job 0: deleteImage_66aec8c2-6186-4b29-a0ad-22137322f1ab: <function <lambda> at 0x7f5ab448d848> (args: () kwargs: {}) >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,074::task::317::TaskManager.Task::(run) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::Job.run: running deleteImage_66aec8c2-6186-4b29-a0ad-22137322f1ab: <function <lambda> at 0x7f5ab448d848> (args: () kwargs: {}) callback None >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,075::task::588::TaskManager.Task::(_updateState) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::moving from state running -> state finished >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,075::task::740::TaskManager.Task::(_save) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8.temp >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,088::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab': < ResourceRef 'Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab', isValid: 'True' obj: 'None'>, 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,089::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,089::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab' >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,089::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab' (0 active users) >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,090::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab' is free, finding out if anyone is waiting for it. >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,090::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.66aec8c2-6186-4b29-a0ad-22137322f1ab', Clearing records. >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,090::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,091::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,091::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,091::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,092::task::900::TaskManager.Task::(_runJobs) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::Task.run: exit - success: result True >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,092::task::978::TaskManager.Task::(_decref) Task=`c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8`::ref 0 aborting False >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:09,092::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-224::DEBUG::2012-11-29 11:12:10,003::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-224::DEBUG::2012-11-29 11:12:10,003::task::588::TaskManager.Task::(_updateState) Task=`deb77962-c853-4e2e-ac37-1f7455ca7d32`::moving from state init -> state preparing >Thread-224::INFO::2012-11-29 11:12:10,003::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-224::DEBUG::2012-11-29 11:12:10,004::taskManager::103::TaskManager::(getAllTasksStatuses) Entry. >Thread-224::DEBUG::2012-11-29 11:12:10,004::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 >Thread-224::DEBUG::2012-11-29 11:12:10,004::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8'} >Thread-224::DEBUG::2012-11-29 11:12:10,005::taskManager::112::TaskManager::(getAllTasksStatuses) Return: {'c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8'}} >Thread-224::INFO::2012-11-29 11:12:10,005::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8'}}} >Thread-224::DEBUG::2012-11-29 11:12:10,005::task::1172::TaskManager.Task::(prepare) Task=`deb77962-c853-4e2e-ac37-1f7455ca7d32`::finished: {'allTasksStatus': {'c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8'}}} >Thread-224::DEBUG::2012-11-29 11:12:10,005::task::588::TaskManager.Task::(_updateState) Task=`deb77962-c853-4e2e-ac37-1f7455ca7d32`::moving from state preparing -> state finished >Thread-224::DEBUG::2012-11-29 11:12:10,006::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-224::DEBUG::2012-11-29 11:12:10,006::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-224::DEBUG::2012-11-29 11:12:10,006::task::978::TaskManager.Task::(_decref) Task=`deb77962-c853-4e2e-ac37-1f7455ca7d32`::ref 0 aborting False >Thread-225::DEBUG::2012-11-29 11:12:10,084::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-225::DEBUG::2012-11-29 11:12:10,084::task::588::TaskManager.Task::(_updateState) Task=`a4e5661d-f705-467d-8846-930079363c93`::moving from state init -> state preparing >Thread-225::INFO::2012-11-29 11:12:10,084::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8', spUUID=None, options=None) >Thread-225::DEBUG::2012-11-29 11:12:10,085::taskManager::161::TaskManager::(clearTask) Entry. taskID: c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8 >Thread-225::DEBUG::2012-11-29 11:12:10,089::taskManager::166::TaskManager::(clearTask) Return. >Thread-225::INFO::2012-11-29 11:12:10,089::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-225::DEBUG::2012-11-29 11:12:10,089::task::1172::TaskManager.Task::(prepare) Task=`a4e5661d-f705-467d-8846-930079363c93`::finished: None >Thread-225::DEBUG::2012-11-29 11:12:10,090::task::588::TaskManager.Task::(_updateState) Task=`a4e5661d-f705-467d-8846-930079363c93`::moving from state preparing -> state finished >Thread-225::DEBUG::2012-11-29 11:12:10,090::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-225::DEBUG::2012-11-29 11:12:10,090::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-225::DEBUG::2012-11-29 11:12:10,091::task::978::TaskManager.Task::(_decref) Task=`a4e5661d-f705-467d-8846-930079363c93`::ref 0 aborting False >Thread-226::DEBUG::2012-11-29 11:12:10,219::task::588::TaskManager.Task::(_updateState) Task=`b42e025f-cad7-45dc-b2d9-a4f6a98023d1`::moving from state init -> state preparing >Thread-226::INFO::2012-11-29 11:12:10,220::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-226::INFO::2012-11-29 11:12:10,220::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00176000595093', 'lastCheck': '5.3', 'code': 0, 'valid': True}} >Thread-226::DEBUG::2012-11-29 11:12:10,220::task::1172::TaskManager.Task::(prepare) Task=`b42e025f-cad7-45dc-b2d9-a4f6a98023d1`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00176000595093', 'lastCheck': '5.3', 'code': 0, 'valid': True}} >Thread-226::DEBUG::2012-11-29 11:12:10,220::task::588::TaskManager.Task::(_updateState) Task=`b42e025f-cad7-45dc-b2d9-a4f6a98023d1`::moving from state preparing -> state finished >Thread-226::DEBUG::2012-11-29 11:12:10,221::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-226::DEBUG::2012-11-29 11:12:10,221::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-226::DEBUG::2012-11-29 11:12:10,221::task::978::TaskManager.Task::(_decref) Task=`b42e025f-cad7-45dc-b2d9-a4f6a98023d1`::ref 0 aborting False >Thread-228::DEBUG::2012-11-29 11:12:12,053::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-228::DEBUG::2012-11-29 11:12:12,053::task::588::TaskManager.Task::(_updateState) Task=`19366610-7481-496d-a03a-89641195f901`::moving from state init -> state preparing >Thread-228::INFO::2012-11-29 11:12:12,054::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-228::INFO::2012-11-29 11:12:12,054::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-228::DEBUG::2012-11-29 11:12:12,054::task::1172::TaskManager.Task::(prepare) Task=`19366610-7481-496d-a03a-89641195f901`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-228::DEBUG::2012-11-29 11:12:12,055::task::588::TaskManager.Task::(_updateState) Task=`19366610-7481-496d-a03a-89641195f901`::moving from state preparing -> state finished >Thread-228::DEBUG::2012-11-29 11:12:12,055::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-228::DEBUG::2012-11-29 11:12:12,055::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-228::DEBUG::2012-11-29 11:12:12,056::task::978::TaskManager.Task::(_decref) Task=`19366610-7481-496d-a03a-89641195f901`::ref 0 aborting False >Thread-229::DEBUG::2012-11-29 11:12:12,088::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-229::DEBUG::2012-11-29 11:12:12,089::task::588::TaskManager.Task::(_updateState) Task=`f7ce3133-667c-4edd-8bf7-460e97545b69`::moving from state init -> state preparing >Thread-229::INFO::2012-11-29 11:12:12,089::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-229::DEBUG::2012-11-29 11:12:12,089::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`654475f1-487c-4d62-9031-40949235566a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-229::DEBUG::2012-11-29 11:12:12,090::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-229::DEBUG::2012-11-29 11:12:12,090::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-229::DEBUG::2012-11-29 11:12:12,090::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`654475f1-487c-4d62-9031-40949235566a`::Granted request >Thread-229::DEBUG::2012-11-29 11:12:12,091::task::817::TaskManager.Task::(resourceAcquired) Task=`f7ce3133-667c-4edd-8bf7-460e97545b69`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-229::DEBUG::2012-11-29 11:12:12,091::task::978::TaskManager.Task::(_decref) Task=`f7ce3133-667c-4edd-8bf7-460e97545b69`::ref 1 aborting False >Thread-229::INFO::2012-11-29 11:12:12,094::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862424399872', 'alerts': [], 'disktotal': '862429642752'}}} >Thread-229::DEBUG::2012-11-29 11:12:12,094::task::1172::TaskManager.Task::(prepare) Task=`f7ce3133-667c-4edd-8bf7-460e97545b69`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862424399872', 'alerts': [], 'disktotal': '862429642752'}}} >Thread-229::DEBUG::2012-11-29 11:12:12,094::task::588::TaskManager.Task::(_updateState) Task=`f7ce3133-667c-4edd-8bf7-460e97545b69`::moving from state preparing -> state finished >Thread-229::DEBUG::2012-11-29 11:12:12,095::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-229::DEBUG::2012-11-29 11:12:12,095::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-229::DEBUG::2012-11-29 11:12:12,095::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-229::DEBUG::2012-11-29 11:12:12,096::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-229::DEBUG::2012-11-29 11:12:12,096::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-229::DEBUG::2012-11-29 11:12:12,096::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-229::DEBUG::2012-11-29 11:12:12,096::task::978::TaskManager.Task::(_decref) Task=`f7ce3133-667c-4edd-8bf7-460e97545b69`::ref 0 aborting False >Thread-234::DEBUG::2012-11-29 11:12:20,189::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-234::DEBUG::2012-11-29 11:12:20,189::task::588::TaskManager.Task::(_updateState) Task=`55e55a41-f99c-4e60-82de-ae5135ab43eb`::moving from state init -> state preparing >Thread-234::INFO::2012-11-29 11:12:20,190::logUtils::37::dispatcher::(wrapper) Run and protect: removeVM(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', vmUUID='1697412a-5b5f-458e-9895-0e38d912cea5', sdUUID=None, options=None) >Thread-234::DEBUG::2012-11-29 11:12:20,190::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`6c6b7ee4-0b29-4b88-9acb-ad4349806af3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-234::DEBUG::2012-11-29 11:12:20,190::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-234::DEBUG::2012-11-29 11:12:20,191::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-234::DEBUG::2012-11-29 11:12:20,191::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`6c6b7ee4-0b29-4b88-9acb-ad4349806af3`::Granted request >Thread-234::DEBUG::2012-11-29 11:12:20,192::task::817::TaskManager.Task::(resourceAcquired) Task=`55e55a41-f99c-4e60-82de-ae5135ab43eb`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-234::DEBUG::2012-11-29 11:12:20,192::task::978::TaskManager.Task::(_decref) Task=`55e55a41-f99c-4e60-82de-ae5135ab43eb`::ref 1 aborting False >Thread-234::INFO::2012-11-29 11:12:20,192::sp::1300::Storage.StoragePool::(removeVM) spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 vmUUID=1697412a-5b5f-458e-9895-0e38d912cea5 sdUUID=None >Thread-234::INFO::2012-11-29 11:12:20,195::logUtils::39::dispatcher::(wrapper) Run and protect: removeVM, Return response: None >Thread-234::DEBUG::2012-11-29 11:12:20,195::task::1172::TaskManager.Task::(prepare) Task=`55e55a41-f99c-4e60-82de-ae5135ab43eb`::finished: None >Thread-234::DEBUG::2012-11-29 11:12:20,196::task::588::TaskManager.Task::(_updateState) Task=`55e55a41-f99c-4e60-82de-ae5135ab43eb`::moving from state preparing -> state finished >Thread-234::DEBUG::2012-11-29 11:12:20,196::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-234::DEBUG::2012-11-29 11:12:20,196::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-234::DEBUG::2012-11-29 11:12:20,197::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-234::DEBUG::2012-11-29 11:12:20,197::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-234::DEBUG::2012-11-29 11:12:20,197::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-234::DEBUG::2012-11-29 11:12:20,197::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-234::DEBUG::2012-11-29 11:12:20,198::task::978::TaskManager.Task::(_decref) Task=`55e55a41-f99c-4e60-82de-ae5135ab43eb`::ref 0 aborting False >Thread-235::DEBUG::2012-11-29 11:12:20,256::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-235::DEBUG::2012-11-29 11:12:20,257::task::588::TaskManager.Task::(_updateState) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::moving from state init -> state preparing >Thread-235::INFO::2012-11-29 11:12:20,257::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', imgUUID='2cee16ba-639a-4980-8a42-9a667b3d2b48', postZero='false', force='false') >Thread-235::INFO::2012-11-29 11:12:20,257::fileSD::255::Storage.StorageDomain::(validate) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-235::DEBUG::2012-11-29 11:12:20,259::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c43d247ba3b2c5cfee7853bd064c721de3fe84ef'] >Thread-235::DEBUG::2012-11-29 11:12:20,260::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48`ReqID=`c8c0eae3-ae75-4317-bfdd-78a5c958ab8c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-235::DEBUG::2012-11-29 11:12:20,261::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48' for lock type 'exclusive' >Thread-235::DEBUG::2012-11-29 11:12:20,261::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48' is free. Now locking as 'exclusive' (1 active user) >Thread-235::DEBUG::2012-11-29 11:12:20,262::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48`ReqID=`c8c0eae3-ae75-4317-bfdd-78a5c958ab8c`::Granted request >Thread-235::DEBUG::2012-11-29 11:12:20,262::task::817::TaskManager.Task::(resourceAcquired) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::_resourcesAcquired: Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48 (exclusive) >Thread-235::DEBUG::2012-11-29 11:12:20,262::task::978::TaskManager.Task::(_decref) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::ref 1 aborting False >Thread-235::DEBUG::2012-11-29 11:12:20,263::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`be647e38-274e-4e28-b135-6fe06dc0e17f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-235::DEBUG::2012-11-29 11:12:20,263::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'shared' >Thread-235::DEBUG::2012-11-29 11:12:20,264::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'shared' (1 active user) >Thread-235::DEBUG::2012-11-29 11:12:20,264::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`be647e38-274e-4e28-b135-6fe06dc0e17f`::Granted request >Thread-235::DEBUG::2012-11-29 11:12:20,265::task::817::TaskManager.Task::(resourceAcquired) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (shared) >Thread-235::DEBUG::2012-11-29 11:12:20,265::task::978::TaskManager.Task::(_decref) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::ref 1 aborting False >Thread-235::DEBUG::2012-11-29 11:12:20,274::task::740::TaskManager.Task::(_save) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb.temp >Thread-235::DEBUG::2012-11-29 11:12:20,282::taskManager::66::TaskManager::(scheduleJob) scheduled job deleteImage_2cee16ba-639a-4980-8a42-9a667b3d2b48 for task dd6a2c2e-7524-4db5-a354-765ddbf17abb >Thread-235::INFO::2012-11-29 11:12:20,282::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-235::DEBUG::2012-11-29 11:12:20,282::task::1167::TaskManager.Task::(prepare) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::Prepare: 1 jobs exist, move to acquiring >Thread-235::DEBUG::2012-11-29 11:12:20,282::task::588::TaskManager.Task::(_updateState) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::moving from state preparing -> state acquiring >Thread-235::DEBUG::2012-11-29 11:12:20,283::task::740::TaskManager.Task::(_save) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb.temp >Thread-235::DEBUG::2012-11-29 11:12:20,294::task::588::TaskManager.Task::(_updateState) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::moving from state acquiring -> state queued >Thread-235::DEBUG::2012-11-29 11:12:20,294::task::740::TaskManager.Task::(_save) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb.temp >Thread-235::DEBUG::2012-11-29 11:12:20,306::taskManager::48::TaskManager::(_queueTask) queueing task: dd6a2c2e-7524-4db5-a354-765ddbf17abb >Thread-235::DEBUG::2012-11-29 11:12:20,306::taskManager::54::TaskManager::(_queueTask) task queued: dd6a2c2e-7524-4db5-a354-765ddbf17abb >c09ce9ab-6ac1-4f24-9659-f75b3c39c7c8::DEBUG::2012-11-29 11:12:20,306::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-235::DEBUG::2012-11-29 11:12:20,306::task::1169::TaskManager.Task::(prepare) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::returning >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,307::threadPool::212::Misc.ThreadPool.WorkerThread::(run) Task: dd6a2c2e-7524-4db5-a354-765ddbf17abb running: <bound method Task.commit of <storage.task.Task instance at 0x7f5ab4478dd0>> with: None >Thread-235::DEBUG::2012-11-29 11:12:20,307::task::978::TaskManager.Task::(_decref) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::ref 0 aborting False >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,307::task::1181::TaskManager.Task::(commit) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::Commiting task: dd6a2c2e-7524-4db5-a354-765ddbf17abb >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,308::task::588::TaskManager.Task::(_updateState) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::moving from state queued -> state running >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,309::task::740::TaskManager.Task::(_save) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb.temp >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,321::task::892::TaskManager.Task::(_runJobs) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::Task.run: running job 0: deleteImage_2cee16ba-639a-4980-8a42-9a667b3d2b48: <function <lambda> at 0x7f5ab446e668> (args: () kwargs: {}) >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,321::task::317::TaskManager.Task::(run) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::Job.run: running deleteImage_2cee16ba-639a-4980-8a42-9a667b3d2b48: <function <lambda> at 0x7f5ab446e668> (args: () kwargs: {}) callback None >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,321::task::588::TaskManager.Task::(_updateState) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::moving from state running -> state finished >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,322::task::740::TaskManager.Task::(_save) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::_save: orig /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb temp /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd/master/tasks/dd6a2c2e-7524-4db5-a354-765ddbf17abb.temp >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,335::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48': < ResourceRef 'Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48', isValid: 'True' obj: 'None'>, 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,335::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,335::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48' >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,336::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48' (0 active users) >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,336::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48' is free, finding out if anyone is waiting for it. >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,336::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.2cee16ba-639a-4980-8a42-9a667b3d2b48', Clearing records. >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,337::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,337::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,337::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,337::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,338::task::900::TaskManager.Task::(_runJobs) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::Task.run: exit - success: result True >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,338::task::978::TaskManager.Task::(_decref) Task=`dd6a2c2e-7524-4db5-a354-765ddbf17abb`::ref 0 aborting False >dd6a2c2e-7524-4db5-a354-765ddbf17abb::DEBUG::2012-11-29 11:12:20,338::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-236::DEBUG::2012-11-29 11:12:20,472::task::588::TaskManager.Task::(_updateState) Task=`f7b6bcdf-2ffc-40d4-8600-fd2696238792`::moving from state init -> state preparing >Thread-236::INFO::2012-11-29 11:12:20,473::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-236::INFO::2012-11-29 11:12:20,473::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00115704536438', 'lastCheck': '5.5', 'code': 0, 'valid': True}} >Thread-236::DEBUG::2012-11-29 11:12:20,473::task::1172::TaskManager.Task::(prepare) Task=`f7b6bcdf-2ffc-40d4-8600-fd2696238792`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00115704536438', 'lastCheck': '5.5', 'code': 0, 'valid': True}} >Thread-236::DEBUG::2012-11-29 11:12:20,473::task::588::TaskManager.Task::(_updateState) Task=`f7b6bcdf-2ffc-40d4-8600-fd2696238792`::moving from state preparing -> state finished >Thread-236::DEBUG::2012-11-29 11:12:20,474::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-236::DEBUG::2012-11-29 11:12:20,474::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2012-11-29 11:12:20,474::task::978::TaskManager.Task::(_decref) Task=`f7b6bcdf-2ffc-40d4-8600-fd2696238792`::ref 0 aborting False >Thread-238::DEBUG::2012-11-29 11:12:22,194::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-238::DEBUG::2012-11-29 11:12:22,195::task::588::TaskManager.Task::(_updateState) Task=`590e4fc7-cc84-42ee-bba9-8d273b4693f7`::moving from state init -> state preparing >Thread-238::INFO::2012-11-29 11:12:22,195::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-238::INFO::2012-11-29 11:12:22,195::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-238::DEBUG::2012-11-29 11:12:22,196::task::1172::TaskManager.Task::(prepare) Task=`590e4fc7-cc84-42ee-bba9-8d273b4693f7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-238::DEBUG::2012-11-29 11:12:22,196::task::588::TaskManager.Task::(_updateState) Task=`590e4fc7-cc84-42ee-bba9-8d273b4693f7`::moving from state preparing -> state finished >Thread-238::DEBUG::2012-11-29 11:12:22,196::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-238::DEBUG::2012-11-29 11:12:22,197::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-238::DEBUG::2012-11-29 11:12:22,197::task::978::TaskManager.Task::(_decref) Task=`590e4fc7-cc84-42ee-bba9-8d273b4693f7`::ref 0 aborting False >Thread-239::DEBUG::2012-11-29 11:12:22,223::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-239::DEBUG::2012-11-29 11:12:22,223::task::588::TaskManager.Task::(_updateState) Task=`7c92bfc2-08cc-457e-aa34-a78a44821e98`::moving from state init -> state preparing >Thread-239::INFO::2012-11-29 11:12:22,224::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-239::DEBUG::2012-11-29 11:12:22,224::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`9b715eb4-4404-4365-93a8-879c8bb4847d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-239::DEBUG::2012-11-29 11:12:22,224::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-239::DEBUG::2012-11-29 11:12:22,225::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-239::DEBUG::2012-11-29 11:12:22,225::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`9b715eb4-4404-4365-93a8-879c8bb4847d`::Granted request >Thread-239::DEBUG::2012-11-29 11:12:22,225::task::817::TaskManager.Task::(resourceAcquired) Task=`7c92bfc2-08cc-457e-aa34-a78a44821e98`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-239::DEBUG::2012-11-29 11:12:22,226::task::978::TaskManager.Task::(_decref) Task=`7c92bfc2-08cc-457e-aa34-a78a44821e98`::ref 1 aborting False >Thread-239::INFO::2012-11-29 11:12:22,228::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862424399872', 'alerts': [], 'disktotal': '862429642752'}}} >Thread-239::DEBUG::2012-11-29 11:12:22,228::task::1172::TaskManager.Task::(prepare) Task=`7c92bfc2-08cc-457e-aa34-a78a44821e98`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862424399872', 'alerts': [], 'disktotal': '862429642752'}}} >Thread-239::DEBUG::2012-11-29 11:12:22,229::task::588::TaskManager.Task::(_updateState) Task=`7c92bfc2-08cc-457e-aa34-a78a44821e98`::moving from state preparing -> state finished >Thread-239::DEBUG::2012-11-29 11:12:22,229::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-239::DEBUG::2012-11-29 11:12:22,229::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-239::DEBUG::2012-11-29 11:12:22,230::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-239::DEBUG::2012-11-29 11:12:22,230::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-239::DEBUG::2012-11-29 11:12:22,230::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-239::DEBUG::2012-11-29 11:12:22,231::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-239::DEBUG::2012-11-29 11:12:22,231::task::978::TaskManager.Task::(_decref) Task=`7c92bfc2-08cc-457e-aa34-a78a44821e98`::ref 0 aborting False >Thread-244::DEBUG::2012-11-29 11:12:30,047::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-244::DEBUG::2012-11-29 11:12:30,048::task::588::TaskManager.Task::(_updateState) Task=`a66a00fe-04ea-4b34-965a-5b0bb06f4a09`::moving from state init -> state preparing >Thread-244::INFO::2012-11-29 11:12:30,048::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-244::DEBUG::2012-11-29 11:12:30,048::taskManager::103::TaskManager::(getAllTasksStatuses) Entry. >Thread-244::DEBUG::2012-11-29 11:12:30,049::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: dd6a2c2e-7524-4db5-a354-765ddbf17abb >Thread-244::DEBUG::2012-11-29 11:12:30,049::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'dd6a2c2e-7524-4db5-a354-765ddbf17abb'} >Thread-244::DEBUG::2012-11-29 11:12:30,049::taskManager::112::TaskManager::(getAllTasksStatuses) Return: {'dd6a2c2e-7524-4db5-a354-765ddbf17abb': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'dd6a2c2e-7524-4db5-a354-765ddbf17abb'}} >Thread-244::INFO::2012-11-29 11:12:30,049::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'dd6a2c2e-7524-4db5-a354-765ddbf17abb': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'dd6a2c2e-7524-4db5-a354-765ddbf17abb'}}} >Thread-244::DEBUG::2012-11-29 11:12:30,050::task::1172::TaskManager.Task::(prepare) Task=`a66a00fe-04ea-4b34-965a-5b0bb06f4a09`::finished: {'allTasksStatus': {'dd6a2c2e-7524-4db5-a354-765ddbf17abb': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'dd6a2c2e-7524-4db5-a354-765ddbf17abb'}}} >Thread-244::DEBUG::2012-11-29 11:12:30,050::task::588::TaskManager.Task::(_updateState) Task=`a66a00fe-04ea-4b34-965a-5b0bb06f4a09`::moving from state preparing -> state finished >Thread-244::DEBUG::2012-11-29 11:12:30,050::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-244::DEBUG::2012-11-29 11:12:30,051::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-244::DEBUG::2012-11-29 11:12:30,051::task::978::TaskManager.Task::(_decref) Task=`a66a00fe-04ea-4b34-965a-5b0bb06f4a09`::ref 0 aborting False >Thread-245::DEBUG::2012-11-29 11:12:30,133::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-245::DEBUG::2012-11-29 11:12:30,134::task::588::TaskManager.Task::(_updateState) Task=`ecbb5b3b-c643-4bd8-9b15-700ffe07d444`::moving from state init -> state preparing >Thread-245::INFO::2012-11-29 11:12:30,134::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='dd6a2c2e-7524-4db5-a354-765ddbf17abb', spUUID=None, options=None) >Thread-245::DEBUG::2012-11-29 11:12:30,134::taskManager::161::TaskManager::(clearTask) Entry. taskID: dd6a2c2e-7524-4db5-a354-765ddbf17abb >Thread-245::DEBUG::2012-11-29 11:12:30,138::taskManager::166::TaskManager::(clearTask) Return. >Thread-245::INFO::2012-11-29 11:12:30,139::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-245::DEBUG::2012-11-29 11:12:30,139::task::1172::TaskManager.Task::(prepare) Task=`ecbb5b3b-c643-4bd8-9b15-700ffe07d444`::finished: None >Thread-245::DEBUG::2012-11-29 11:12:30,139::task::588::TaskManager.Task::(_updateState) Task=`ecbb5b3b-c643-4bd8-9b15-700ffe07d444`::moving from state preparing -> state finished >Thread-245::DEBUG::2012-11-29 11:12:30,140::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-245::DEBUG::2012-11-29 11:12:30,140::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-245::DEBUG::2012-11-29 11:12:30,140::task::978::TaskManager.Task::(_decref) Task=`ecbb5b3b-c643-4bd8-9b15-700ffe07d444`::ref 0 aborting False >Thread-246::DEBUG::2012-11-29 11:12:30,682::task::588::TaskManager.Task::(_updateState) Task=`bc1c2132-0578-4e3b-8931-b46128933b2c`::moving from state init -> state preparing >Thread-246::INFO::2012-11-29 11:12:30,683::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-246::INFO::2012-11-29 11:12:30,683::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00116205215454', 'lastCheck': '5.7', 'code': 0, 'valid': True}} >Thread-246::DEBUG::2012-11-29 11:12:30,683::task::1172::TaskManager.Task::(prepare) Task=`bc1c2132-0578-4e3b-8931-b46128933b2c`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00116205215454', 'lastCheck': '5.7', 'code': 0, 'valid': True}} >Thread-246::DEBUG::2012-11-29 11:12:30,684::task::588::TaskManager.Task::(_updateState) Task=`bc1c2132-0578-4e3b-8931-b46128933b2c`::moving from state preparing -> state finished >Thread-246::DEBUG::2012-11-29 11:12:30,684::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-246::DEBUG::2012-11-29 11:12:30,684::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-246::DEBUG::2012-11-29 11:12:30,685::task::978::TaskManager.Task::(_decref) Task=`bc1c2132-0578-4e3b-8931-b46128933b2c`::ref 0 aborting False >Thread-248::DEBUG::2012-11-29 11:12:32,274::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-248::DEBUG::2012-11-29 11:12:32,275::task::588::TaskManager.Task::(_updateState) Task=`7cefe0d4-348d-4f90-b061-bff553561ca4`::moving from state init -> state preparing >Thread-248::INFO::2012-11-29 11:12:32,275::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-248::INFO::2012-11-29 11:12:32,276::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-248::DEBUG::2012-11-29 11:12:32,276::task::1172::TaskManager.Task::(prepare) Task=`7cefe0d4-348d-4f90-b061-bff553561ca4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-248::DEBUG::2012-11-29 11:12:32,276::task::588::TaskManager.Task::(_updateState) Task=`7cefe0d4-348d-4f90-b061-bff553561ca4`::moving from state preparing -> state finished >Thread-248::DEBUG::2012-11-29 11:12:32,277::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-248::DEBUG::2012-11-29 11:12:32,277::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-248::DEBUG::2012-11-29 11:12:32,277::task::978::TaskManager.Task::(_decref) Task=`7cefe0d4-348d-4f90-b061-bff553561ca4`::ref 0 aborting False >Thread-249::DEBUG::2012-11-29 11:12:32,304::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-249::DEBUG::2012-11-29 11:12:32,304::task::588::TaskManager.Task::(_updateState) Task=`d4ad8d10-849a-4fca-9988-7aeb06d0c933`::moving from state init -> state preparing >Thread-249::INFO::2012-11-29 11:12:32,305::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-249::DEBUG::2012-11-29 11:12:32,305::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`9fd3677b-cea6-4f72-aeac-b6b509b9f1ae`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-249::DEBUG::2012-11-29 11:12:32,305::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-249::DEBUG::2012-11-29 11:12:32,306::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-249::DEBUG::2012-11-29 11:12:32,306::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`9fd3677b-cea6-4f72-aeac-b6b509b9f1ae`::Granted request >Thread-249::DEBUG::2012-11-29 11:12:32,306::task::817::TaskManager.Task::(resourceAcquired) Task=`d4ad8d10-849a-4fca-9988-7aeb06d0c933`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-249::DEBUG::2012-11-29 11:12:32,307::task::978::TaskManager.Task::(_decref) Task=`d4ad8d10-849a-4fca-9988-7aeb06d0c933`::ref 1 aborting False >Thread-249::INFO::2012-11-29 11:12:32,309::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862424399872', 'alerts': [], 'disktotal': '862429642752'}}} >Thread-249::DEBUG::2012-11-29 11:12:32,309::task::1172::TaskManager.Task::(prepare) Task=`d4ad8d10-849a-4fca-9988-7aeb06d0c933`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862424399872', 'alerts': [], 'disktotal': '862429642752'}}} >Thread-249::DEBUG::2012-11-29 11:12:32,310::task::588::TaskManager.Task::(_updateState) Task=`d4ad8d10-849a-4fca-9988-7aeb06d0c933`::moving from state preparing -> state finished >Thread-249::DEBUG::2012-11-29 11:12:32,310::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-249::DEBUG::2012-11-29 11:12:32,310::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-249::DEBUG::2012-11-29 11:12:32,311::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-249::DEBUG::2012-11-29 11:12:32,311::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-249::DEBUG::2012-11-29 11:12:32,311::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-249::DEBUG::2012-11-29 11:12:32,312::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-249::DEBUG::2012-11-29 11:12:32,312::task::978::TaskManager.Task::(_decref) Task=`d4ad8d10-849a-4fca-9988-7aeb06d0c933`::ref 0 aborting False >Thread-254::DEBUG::2012-11-29 11:12:40,904::task::588::TaskManager.Task::(_updateState) Task=`982c3f73-c66f-4bcd-8657-1a4d24b0bdb9`::moving from state init -> state preparing >Thread-254::INFO::2012-11-29 11:12:40,905::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-254::INFO::2012-11-29 11:12:40,905::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.0013120174408', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-254::DEBUG::2012-11-29 11:12:40,905::task::1172::TaskManager.Task::(prepare) Task=`982c3f73-c66f-4bcd-8657-1a4d24b0bdb9`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.0013120174408', 'lastCheck': '5.9', 'code': 0, 'valid': True}} >Thread-254::DEBUG::2012-11-29 11:12:40,906::task::588::TaskManager.Task::(_updateState) Task=`982c3f73-c66f-4bcd-8657-1a4d24b0bdb9`::moving from state preparing -> state finished >Thread-254::DEBUG::2012-11-29 11:12:40,906::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-254::DEBUG::2012-11-29 11:12:40,906::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-254::DEBUG::2012-11-29 11:12:40,907::task::978::TaskManager.Task::(_decref) Task=`982c3f73-c66f-4bcd-8657-1a4d24b0bdb9`::ref 0 aborting False >Thread-256::DEBUG::2012-11-29 11:12:42,356::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-256::DEBUG::2012-11-29 11:12:42,356::task::588::TaskManager.Task::(_updateState) Task=`e32a3fa0-a798-4f84-a13e-e59067298a09`::moving from state init -> state preparing >Thread-256::INFO::2012-11-29 11:12:42,356::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-256::INFO::2012-11-29 11:12:42,357::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-256::DEBUG::2012-11-29 11:12:42,357::task::1172::TaskManager.Task::(prepare) Task=`e32a3fa0-a798-4f84-a13e-e59067298a09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-256::DEBUG::2012-11-29 11:12:42,357::task::588::TaskManager.Task::(_updateState) Task=`e32a3fa0-a798-4f84-a13e-e59067298a09`::moving from state preparing -> state finished >Thread-256::DEBUG::2012-11-29 11:12:42,358::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256::DEBUG::2012-11-29 11:12:42,358::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256::DEBUG::2012-11-29 11:12:42,358::task::978::TaskManager.Task::(_decref) Task=`e32a3fa0-a798-4f84-a13e-e59067298a09`::ref 0 aborting False >Thread-257::DEBUG::2012-11-29 11:12:42,388::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-257::DEBUG::2012-11-29 11:12:42,388::task::588::TaskManager.Task::(_updateState) Task=`5f89b11a-2ad4-485f-b3b8-a0510ceca278`::moving from state init -> state preparing >Thread-257::INFO::2012-11-29 11:12:42,389::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-257::DEBUG::2012-11-29 11:12:42,389::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`46c42656-d244-4ce2-90a2-485fb7891e29`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-257::DEBUG::2012-11-29 11:12:42,390::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-257::DEBUG::2012-11-29 11:12:42,390::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-257::DEBUG::2012-11-29 11:12:42,390::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`46c42656-d244-4ce2-90a2-485fb7891e29`::Granted request >Thread-257::DEBUG::2012-11-29 11:12:42,391::task::817::TaskManager.Task::(resourceAcquired) Task=`5f89b11a-2ad4-485f-b3b8-a0510ceca278`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-257::DEBUG::2012-11-29 11:12:42,391::task::978::TaskManager.Task::(_decref) Task=`5f89b11a-2ad4-485f-b3b8-a0510ceca278`::ref 1 aborting False >Thread-257::INFO::2012-11-29 11:12:42,393::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862431739904'}}} >Thread-257::DEBUG::2012-11-29 11:12:42,394::task::1172::TaskManager.Task::(prepare) Task=`5f89b11a-2ad4-485f-b3b8-a0510ceca278`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862431739904'}}} >Thread-257::DEBUG::2012-11-29 11:12:42,394::task::588::TaskManager.Task::(_updateState) Task=`5f89b11a-2ad4-485f-b3b8-a0510ceca278`::moving from state preparing -> state finished >Thread-257::DEBUG::2012-11-29 11:12:42,394::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-257::DEBUG::2012-11-29 11:12:42,395::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-257::DEBUG::2012-11-29 11:12:42,395::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-257::DEBUG::2012-11-29 11:12:42,395::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-257::DEBUG::2012-11-29 11:12:42,396::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-257::DEBUG::2012-11-29 11:12:42,396::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-257::DEBUG::2012-11-29 11:12:42,396::task::978::TaskManager.Task::(_decref) Task=`5f89b11a-2ad4-485f-b3b8-a0510ceca278`::ref 0 aborting False >Thread-262::DEBUG::2012-11-29 11:12:51,127::task::588::TaskManager.Task::(_updateState) Task=`fbe76a66-62a6-4639-a86e-78575fe704c7`::moving from state init -> state preparing >Thread-262::INFO::2012-11-29 11:12:51,127::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-262::INFO::2012-11-29 11:12:51,128::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00116896629333', 'lastCheck': '6.2', 'code': 0, 'valid': True}} >Thread-262::DEBUG::2012-11-29 11:12:51,128::task::1172::TaskManager.Task::(prepare) Task=`fbe76a66-62a6-4639-a86e-78575fe704c7`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00116896629333', 'lastCheck': '6.2', 'code': 0, 'valid': True}} >Thread-262::DEBUG::2012-11-29 11:12:51,128::task::588::TaskManager.Task::(_updateState) Task=`fbe76a66-62a6-4639-a86e-78575fe704c7`::moving from state preparing -> state finished >Thread-262::DEBUG::2012-11-29 11:12:51,129::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-262::DEBUG::2012-11-29 11:12:51,129::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-262::DEBUG::2012-11-29 11:12:51,129::task::978::TaskManager.Task::(_decref) Task=`fbe76a66-62a6-4639-a86e-78575fe704c7`::ref 0 aborting False >Thread-264::DEBUG::2012-11-29 11:12:52,446::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-264::DEBUG::2012-11-29 11:12:52,447::task::588::TaskManager.Task::(_updateState) Task=`58aed872-a7ac-4d34-a931-c5429907dd28`::moving from state init -> state preparing >Thread-264::INFO::2012-11-29 11:12:52,447::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-264::INFO::2012-11-29 11:12:52,447::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-264::DEBUG::2012-11-29 11:12:52,448::task::1172::TaskManager.Task::(prepare) Task=`58aed872-a7ac-4d34-a931-c5429907dd28`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-264::DEBUG::2012-11-29 11:12:52,448::task::588::TaskManager.Task::(_updateState) Task=`58aed872-a7ac-4d34-a931-c5429907dd28`::moving from state preparing -> state finished >Thread-264::DEBUG::2012-11-29 11:12:52,448::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-264::DEBUG::2012-11-29 11:12:52,449::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-264::DEBUG::2012-11-29 11:12:52,449::task::978::TaskManager.Task::(_decref) Task=`58aed872-a7ac-4d34-a931-c5429907dd28`::ref 0 aborting False >Thread-265::DEBUG::2012-11-29 11:12:52,483::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-265::DEBUG::2012-11-29 11:12:52,483::task::588::TaskManager.Task::(_updateState) Task=`382b1a85-5ca6-4d8a-93fd-407b647178ff`::moving from state init -> state preparing >Thread-265::INFO::2012-11-29 11:12:52,484::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-265::DEBUG::2012-11-29 11:12:52,484::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`85cefe61-5895-44e3-bb13-510749d080a7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-265::DEBUG::2012-11-29 11:12:52,484::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'shared' >Thread-265::DEBUG::2012-11-29 11:12:52,485::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'shared' (1 active user) >Thread-265::DEBUG::2012-11-29 11:12:52,485::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`85cefe61-5895-44e3-bb13-510749d080a7`::Granted request >Thread-265::DEBUG::2012-11-29 11:12:52,485::task::817::TaskManager.Task::(resourceAcquired) Task=`382b1a85-5ca6-4d8a-93fd-407b647178ff`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (shared) >Thread-265::DEBUG::2012-11-29 11:12:52,486::task::978::TaskManager.Task::(_decref) Task=`382b1a85-5ca6-4d8a-93fd-407b647178ff`::ref 1 aborting False >Thread-265::INFO::2012-11-29 11:12:52,488::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862431739904'}}} >Thread-265::DEBUG::2012-11-29 11:12:52,488::task::1172::TaskManager.Task::(prepare) Task=`382b1a85-5ca6-4d8a-93fd-407b647178ff`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'name': 'DefaultRest', 'version': '3', 'domains': 'f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'status': 'Active', 'diskfree': '862428594176', 'alerts': [], 'disktotal': '862431739904'}}} >Thread-265::DEBUG::2012-11-29 11:12:52,489::task::588::TaskManager.Task::(_updateState) Task=`382b1a85-5ca6-4d8a-93fd-407b647178ff`::moving from state preparing -> state finished >Thread-265::DEBUG::2012-11-29 11:12:52,489::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-265::DEBUG::2012-11-29 11:12:52,489::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-265::DEBUG::2012-11-29 11:12:52,490::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-265::DEBUG::2012-11-29 11:12:52,490::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-265::DEBUG::2012-11-29 11:12:52,490::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-265::DEBUG::2012-11-29 11:12:52,491::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-265::DEBUG::2012-11-29 11:12:52,491::task::978::TaskManager.Task::(_decref) Task=`382b1a85-5ca6-4d8a-93fd-407b647178ff`::ref 0 aborting False >Thread-270::DEBUG::2012-11-29 11:13:01,334::task::588::TaskManager.Task::(_updateState) Task=`ff1c4e46-f87c-4b59-b306-56206ea2bc77`::moving from state init -> state preparing >Thread-270::INFO::2012-11-29 11:13:01,334::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-270::INFO::2012-11-29 11:13:01,334::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00136303901672', 'lastCheck': '6.4', 'code': 0, 'valid': True}} >Thread-270::DEBUG::2012-11-29 11:13:01,335::task::1172::TaskManager.Task::(prepare) Task=`ff1c4e46-f87c-4b59-b306-56206ea2bc77`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00136303901672', 'lastCheck': '6.4', 'code': 0, 'valid': True}} >Thread-270::DEBUG::2012-11-29 11:13:01,335::task::588::TaskManager.Task::(_updateState) Task=`ff1c4e46-f87c-4b59-b306-56206ea2bc77`::moving from state preparing -> state finished >Thread-270::DEBUG::2012-11-29 11:13:01,335::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-270::DEBUG::2012-11-29 11:13:01,335::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-270::DEBUG::2012-11-29 11:13:01,336::task::978::TaskManager.Task::(_decref) Task=`ff1c4e46-f87c-4b59-b306-56206ea2bc77`::ref 0 aborting False >Thread-272::DEBUG::2012-11-29 11:13:01,987::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-272::DEBUG::2012-11-29 11:13:01,987::task::588::TaskManager.Task::(_updateState) Task=`7ff001b8-efac-43fc-acb0-8012748f933d`::moving from state init -> state preparing >Thread-272::INFO::2012-11-29 11:13:01,987::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-272::DEBUG::2012-11-29 11:13:01,988::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`0d4cd46f-b85f-43e4-bafb-3e197a88a4fb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-272::DEBUG::2012-11-29 11:13:01,988::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-272::DEBUG::2012-11-29 11:13:01,989::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-272::DEBUG::2012-11-29 11:13:01,989::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`0d4cd46f-b85f-43e4-bafb-3e197a88a4fb`::Granted request >Thread-272::DEBUG::2012-11-29 11:13:01,989::task::817::TaskManager.Task::(resourceAcquired) Task=`7ff001b8-efac-43fc-acb0-8012748f933d`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (exclusive) >Thread-272::DEBUG::2012-11-29 11:13:01,990::task::978::TaskManager.Task::(_decref) Task=`7ff001b8-efac-43fc-acb0-8012748f933d`::ref 1 aborting False >Thread-272::DEBUG::2012-11-29 11:13:01,990::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`27244692-d74c-486c-a986-157f10b0d8e4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-272::DEBUG::2012-11-29 11:13:01,990::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'exclusive' >Thread-272::DEBUG::2012-11-29 11:13:01,991::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'exclusive' (1 active user) >Thread-272::DEBUG::2012-11-29 11:13:01,991::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`27244692-d74c-486c-a986-157f10b0d8e4`::Granted request >Thread-272::DEBUG::2012-11-29 11:13:01,991::task::817::TaskManager.Task::(resourceAcquired) Task=`7ff001b8-efac-43fc-acb0-8012748f933d`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (exclusive) >Thread-272::DEBUG::2012-11-29 11:13:01,992::task::978::TaskManager.Task::(_decref) Task=`7ff001b8-efac-43fc-acb0-8012748f933d`::ref 1 aborting False >Thread-272::INFO::2012-11-29 11:13:01,992::sp::1083::Storage.StoragePool::(deactivateSD) sdUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7 spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-272::INFO::2012-11-29 11:13:01,992::sp::1107::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-272::INFO::2012-11-29 11:13:01,993::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-272::DEBUG::2012-11-29 11:13:01,993::task::1172::TaskManager.Task::(prepare) Task=`7ff001b8-efac-43fc-acb0-8012748f933d`::finished: None >Thread-272::DEBUG::2012-11-29 11:13:01,993::task::588::TaskManager.Task::(_updateState) Task=`7ff001b8-efac-43fc-acb0-8012748f933d`::moving from state preparing -> state finished >Thread-272::DEBUG::2012-11-29 11:13:01,993::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>, 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-272::DEBUG::2012-11-29 11:13:01,994::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-272::DEBUG::2012-11-29 11:13:01,994::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-272::DEBUG::2012-11-29 11:13:01,994::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-272::DEBUG::2012-11-29 11:13:01,995::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-272::DEBUG::2012-11-29 11:13:01,995::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-272::DEBUG::2012-11-29 11:13:01,995::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-272::DEBUG::2012-11-29 11:13:01,996::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-272::DEBUG::2012-11-29 11:13:01,996::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-272::DEBUG::2012-11-29 11:13:01,996::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-272::DEBUG::2012-11-29 11:13:01,997::task::978::TaskManager.Task::(_decref) Task=`7ff001b8-efac-43fc-acb0-8012748f933d`::ref 0 aborting False >Thread-273::DEBUG::2012-11-29 11:13:02,051::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-273::DEBUG::2012-11-29 11:13:02,052::task::588::TaskManager.Task::(_updateState) Task=`3df2e0cf-589c-4e5a-8284-a17d41858243`::moving from state init -> state preparing >Thread-273::INFO::2012-11-29 11:13:02,052::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-273::DEBUG::2012-11-29 11:13:02,052::taskManager::103::TaskManager::(getAllTasksStatuses) Entry. >Thread-273::DEBUG::2012-11-29 11:13:02,052::taskManager::112::TaskManager::(getAllTasksStatuses) Return: {} >Thread-273::INFO::2012-11-29 11:13:02,053::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-273::DEBUG::2012-11-29 11:13:02,053::task::1172::TaskManager.Task::(prepare) Task=`3df2e0cf-589c-4e5a-8284-a17d41858243`::finished: {'allTasksStatus': {}} >Thread-273::DEBUG::2012-11-29 11:13:02,053::task::588::TaskManager.Task::(_updateState) Task=`3df2e0cf-589c-4e5a-8284-a17d41858243`::moving from state preparing -> state finished >Thread-273::DEBUG::2012-11-29 11:13:02,053::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-273::DEBUG::2012-11-29 11:13:02,054::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-273::DEBUG::2012-11-29 11:13:02,054::task::978::TaskManager.Task::(_decref) Task=`3df2e0cf-589c-4e5a-8284-a17d41858243`::ref 0 aborting False >Thread-274::DEBUG::2012-11-29 11:13:02,079::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-274::DEBUG::2012-11-29 11:13:02,080::task::588::TaskManager.Task::(_updateState) Task=`62bb7d69-1cdb-4ffd-bfda-1edd0a987359`::moving from state init -> state preparing >Thread-274::INFO::2012-11-29 11:13:02,080::logUtils::37::dispatcher::(wrapper) Run and protect: spmStop(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-274::DEBUG::2012-11-29 11:13:02,081::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`aec1887b-e55c-454f-89db-1da832cbe4e1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-274::DEBUG::2012-11-29 11:13:02,081::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-274::DEBUG::2012-11-29 11:13:02,081::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-274::DEBUG::2012-11-29 11:13:02,082::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`aec1887b-e55c-454f-89db-1da832cbe4e1`::Granted request >Thread-274::DEBUG::2012-11-29 11:13:02,082::task::817::TaskManager.Task::(resourceAcquired) Task=`62bb7d69-1cdb-4ffd-bfda-1edd0a987359`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (exclusive) >Thread-274::DEBUG::2012-11-29 11:13:02,082::task::978::TaskManager.Task::(_decref) Task=`62bb7d69-1cdb-4ffd-bfda-1edd0a987359`::ref 1 aborting False >Thread-274::DEBUG::2012-11-29 11:13:02,083::sp::323::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-274::DEBUG::2012-11-29 11:13:02,083::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`89ff72e4-c7e8-4d9c-b182-21f1c1a9d363`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-274::DEBUG::2012-11-29 11:13:02,083::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-274::DEBUG::2012-11-29 11:13:02,084::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-274::DEBUG::2012-11-29 11:13:02,084::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`89ff72e4-c7e8-4d9c-b182-21f1c1a9d363`::Granted request >Thread-274::DEBUG::2012-11-29 11:13:02,084::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-274::DEBUG::2012-11-29 11:13:02,085::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-274::DEBUG::2012-11-29 11:13:02,085::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-274::DEBUG::2012-11-29 11:13:02,085::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-274::DEBUG::2012-11-29 11:13:02,088::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,090::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,092::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,094::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,095::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,097::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,099::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,101::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,103::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,104::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,106::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,108::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,110::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,112::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,113::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,115::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,117::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,119::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,121::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,123::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,124::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,126::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,128::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,130::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,132::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,133::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,135::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,137::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,139::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,141::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,142::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,144::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,146::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,148::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,150::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,151::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,153::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,155::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,157::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,159::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,160::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,162::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,164::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,166::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >Thread-274::DEBUG::2012-11-29 11:13:02,166::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >Thread-274::DEBUG::2012-11-29 11:13:02,166::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >Thread-274::DEBUG::2012-11-29 11:13:02,167::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ee577cc6e3f8e646edc5c5f08f7251ecf32f0e69'] >Thread-274::DEBUG::2012-11-29 11:13:02,171::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >Thread-274::INFO::2012-11-29 11:13:02,171::safelease::239::SANLock::(release) Releasing cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-274::DEBUG::2012-11-29 11:13:02,174::safelease::250::SANLock::(release) Cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully released >Thread-274::INFO::2012-11-29 11:13:02,174::logUtils::39::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-274::DEBUG::2012-11-29 11:13:02,174::task::1172::TaskManager.Task::(prepare) Task=`62bb7d69-1cdb-4ffd-bfda-1edd0a987359`::finished: None >Thread-274::DEBUG::2012-11-29 11:13:02,175::task::588::TaskManager.Task::(_updateState) Task=`62bb7d69-1cdb-4ffd-bfda-1edd0a987359`::moving from state preparing -> state finished >Thread-274::DEBUG::2012-11-29 11:13:02,175::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-274::DEBUG::2012-11-29 11:13:02,175::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-274::DEBUG::2012-11-29 11:13:02,176::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-274::DEBUG::2012-11-29 11:13:02,176::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-274::DEBUG::2012-11-29 11:13:02,176::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-274::DEBUG::2012-11-29 11:13:02,177::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-274::DEBUG::2012-11-29 11:13:02,177::task::978::TaskManager.Task::(_decref) Task=`62bb7d69-1cdb-4ffd-bfda-1edd0a987359`::ref 0 aborting False >Thread-275::DEBUG::2012-11-29 11:13:02,212::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-275::DEBUG::2012-11-29 11:13:02,213::task::588::TaskManager.Task::(_updateState) Task=`80e5c7d8-125b-485b-bdc3-815acf2320d3`::moving from state init -> state preparing >Thread-275::INFO::2012-11-29 11:13:02,213::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', hostID=1, scsiKey='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', remove=False, options=None) >Thread-275::DEBUG::2012-11-29 11:13:02,213::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`8120509c-02e6-4488-b111-403d7469b0fe`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-275::DEBUG::2012-11-29 11:13:02,214::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-275::DEBUG::2012-11-29 11:13:02,214::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-275::DEBUG::2012-11-29 11:13:02,214::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`8120509c-02e6-4488-b111-403d7469b0fe`::Granted request >Thread-275::DEBUG::2012-11-29 11:13:02,215::task::817::TaskManager.Task::(resourceAcquired) Task=`80e5c7d8-125b-485b-bdc3-815acf2320d3`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (exclusive) >Thread-275::DEBUG::2012-11-29 11:13:02,215::task::978::TaskManager.Task::(_decref) Task=`80e5c7d8-125b-485b-bdc3-815acf2320d3`::ref 1 aborting False >Thread-275::INFO::2012-11-29 11:13:02,215::sp::668::Storage.StoragePool::(disconnect) Disconnect from the storage pool 21ea8081-3262-478a-8e4a-8e46b0e2fbc9 >Thread-66::DEBUG::2012-11-29 11:13:02,216::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-66::INFO::2012-11-29 11:13:02,216::safelease::183::SANLock::(releaseHostId) Releasing host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 1) >Thread-66::DEBUG::2012-11-29 11:13:04,217::safelease::193::SANLock::(releaseHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 released successfully (id: 1) >Thread-275::INFO::2012-11-29 11:13:04,217::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-275::DEBUG::2012-11-29 11:13:04,218::task::1172::TaskManager.Task::(prepare) Task=`80e5c7d8-125b-485b-bdc3-815acf2320d3`::finished: True >Thread-275::DEBUG::2012-11-29 11:13:04,218::task::588::TaskManager.Task::(_updateState) Task=`80e5c7d8-125b-485b-bdc3-815acf2320d3`::moving from state preparing -> state finished >Thread-275::DEBUG::2012-11-29 11:13:04,218::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >Thread-275::DEBUG::2012-11-29 11:13:04,219::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-275::DEBUG::2012-11-29 11:13:04,219::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-275::DEBUG::2012-11-29 11:13:04,219::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-275::DEBUG::2012-11-29 11:13:04,220::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-275::DEBUG::2012-11-29 11:13:04,220::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-275::DEBUG::2012-11-29 11:13:04,220::task::978::TaskManager.Task::(_decref) Task=`80e5c7d8-125b-485b-bdc3-815acf2320d3`::ref 0 aborting False >Thread-277::DEBUG::2012-11-29 11:13:04,256::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-277::DEBUG::2012-11-29 11:13:04,257::task::588::TaskManager.Task::(_updateState) Task=`e66fabeb-f2c5-4aa3-b30e-1be0e9274848`::moving from state init -> state preparing >Thread-277::INFO::2012-11-29 11:13:04,257::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-277::DEBUG::2012-11-29 11:13:04,258::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391' (cwd None) >Thread-277::DEBUG::2012-11-29 11:13:04,291::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-277::DEBUG::2012-11-29 11:13:04,295::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-277::DEBUG::2012-11-29 11:13:04,296::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-277::DEBUG::2012-11-29 11:13:04,296::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-277::DEBUG::2012-11-29 11:13:04,296::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-277::DEBUG::2012-11-29 11:13:04,307::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-277::DEBUG::2012-11-29 11:13:04,307::misc::1054::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-277::DEBUG::2012-11-29 11:13:04,309::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-277::DEBUG::2012-11-29 11:13:05,313::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-277::DEBUG::2012-11-29 11:13:06,317::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-277::DEBUG::2012-11-29 11:13:07,320::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-277::DEBUG::2012-11-29 11:13:07,323::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-277::DEBUG::2012-11-29 11:13:07,325::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-277::DEBUG::2012-11-29 11:13:08,328::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-277::DEBUG::2012-11-29 11:13:10,331::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-277::DEBUG::2012-11-29 11:13:10,381::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-277::DEBUG::2012-11-29 11:13:10,381::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-277::DEBUG::2012-11-29 11:13:10,382::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-277::DEBUG::2012-11-29 11:13:10,382::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-277::DEBUG::2012-11-29 11:13:10,383::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-277::DEBUG::2012-11-29 11:13:10,383::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-277::DEBUG::2012-11-29 11:13:10,383::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-277::DEBUG::2012-11-29 11:13:10,384::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-277::INFO::2012-11-29 11:13:10,384::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-277::DEBUG::2012-11-29 11:13:10,384::task::1172::TaskManager.Task::(prepare) Task=`e66fabeb-f2c5-4aa3-b30e-1be0e9274848`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-277::DEBUG::2012-11-29 11:13:10,385::task::588::TaskManager.Task::(_updateState) Task=`e66fabeb-f2c5-4aa3-b30e-1be0e9274848`::moving from state preparing -> state finished >Thread-277::DEBUG::2012-11-29 11:13:10,385::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-277::DEBUG::2012-11-29 11:13:10,385::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-277::DEBUG::2012-11-29 11:13:10,385::task::978::TaskManager.Task::(_decref) Task=`e66fabeb-f2c5-4aa3-b30e-1be0e9274848`::ref 0 aborting False >Thread-281::DEBUG::2012-11-29 11:13:11,370::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-281::DEBUG::2012-11-29 11:13:11,371::task::588::TaskManager.Task::(_updateState) Task=`24c0bef8-cae6-4856-a35e-ea5c576f8769`::moving from state init -> state preparing >Thread-281::INFO::2012-11-29 11:13:11,371::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-281::INFO::2012-11-29 11:13:11,371::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-281::DEBUG::2012-11-29 11:13:11,372::task::1172::TaskManager.Task::(prepare) Task=`24c0bef8-cae6-4856-a35e-ea5c576f8769`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-281::DEBUG::2012-11-29 11:13:11,372::task::588::TaskManager.Task::(_updateState) Task=`24c0bef8-cae6-4856-a35e-ea5c576f8769`::moving from state preparing -> state finished >Thread-281::DEBUG::2012-11-29 11:13:11,372::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-281::DEBUG::2012-11-29 11:13:11,373::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-281::DEBUG::2012-11-29 11:13:11,373::task::978::TaskManager.Task::(_decref) Task=`24c0bef8-cae6-4856-a35e-ea5c576f8769`::ref 0 aborting False >Thread-282::DEBUG::2012-11-29 11:13:11,403::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-282::DEBUG::2012-11-29 11:13:11,403::task::588::TaskManager.Task::(_updateState) Task=`059787cc-0c03-4706-82f4-15279f149a4b`::moving from state init -> state preparing >Thread-282::INFO::2012-11-29 11:13:11,404::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-282::DEBUG::2012-11-29 11:13:11,408::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391' (cwd None) >Thread-282::INFO::2012-11-29 11:13:11,438::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-282::DEBUG::2012-11-29 11:13:11,438::task::1172::TaskManager.Task::(prepare) Task=`059787cc-0c03-4706-82f4-15279f149a4b`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-282::DEBUG::2012-11-29 11:13:11,438::task::588::TaskManager.Task::(_updateState) Task=`059787cc-0c03-4706-82f4-15279f149a4b`::moving from state preparing -> state finished >Thread-282::DEBUG::2012-11-29 11:13:11,439::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-282::DEBUG::2012-11-29 11:13:11,439::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-282::DEBUG::2012-11-29 11:13:11,439::task::978::TaskManager.Task::(_decref) Task=`059787cc-0c03-4706-82f4-15279f149a4b`::ref 0 aborting False >Thread-283::DEBUG::2012-11-29 11:13:11,467::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-283::DEBUG::2012-11-29 11:13:11,468::task::588::TaskManager.Task::(_updateState) Task=`dca0fa3a-c55f-4403-a07a-a7b4b829fce6`::moving from state init -> state preparing >Thread-283::INFO::2012-11-29 11:13:11,468::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', hostID=1, scsiKey='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', msdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', masterVersion=1, options=None) >Thread-283::DEBUG::2012-11-29 11:13:11,469::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`9219bdd6-c44c-4a69-9b00-8febb9ac7e90`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-283::DEBUG::2012-11-29 11:13:11,469::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-283::DEBUG::2012-11-29 11:13:11,470::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-283::DEBUG::2012-11-29 11:13:11,470::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`9219bdd6-c44c-4a69-9b00-8febb9ac7e90`::Granted request >Thread-283::INFO::2012-11-29 11:13:11,470::sp::632::Storage.StoragePool::(connect) Connect host #1 to the storage pool 21ea8081-3262-478a-8e4a-8e46b0e2fbc9 with master domain: f1008a0c-010a-45a0-b80c-f5e8514a76e7 (ver = 1) >Thread-283::DEBUG::2012-11-29 11:13:11,471::sp::1539::Storage.StoragePool::(getMasterDomain) Master domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 verified, version 1 >Thread-283::DEBUG::2012-11-29 11:13:11,471::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-283::DEBUG::2012-11-29 11:13:11,472::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-283::DEBUG::2012-11-29 11:13:11,475::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ee577cc6e3f8e646edc5c5f08f7251ecf32f0e69'] >Thread-284::DEBUG::2012-11-29 11:13:11,476::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-283::DEBUG::2012-11-29 11:13:11,476::sp::1573::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `21ea8081-3262-478a-8e4a-8e46b0e2fbc9` started monitoring domain `f1008a0c-010a-45a0-b80c-f5e8514a76e7` >Thread-283::DEBUG::2012-11-29 11:13:11,477::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-283::DEBUG::2012-11-29 11:13:11,478::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 11:13:11,481::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-284::INFO::2012-11-29 11:13:11,489::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 1) >Thread-284::DEBUG::2012-11-29 11:13:11,493::safelease::178::SANLock::(acquireHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully acquired (id: 1) >Thread-285::DEBUG::2012-11-29 11:13:11,555::task::588::TaskManager.Task::(_updateState) Task=`41ab770e-bce6-40b0-94f9-c6da4743b0e0`::moving from state init -> state preparing >Thread-285::INFO::2012-11-29 11:13:11,555::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-285::INFO::2012-11-29 11:13:11,555::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-285::DEBUG::2012-11-29 11:13:11,556::task::1172::TaskManager.Task::(prepare) Task=`41ab770e-bce6-40b0-94f9-c6da4743b0e0`::finished: {} >Thread-285::DEBUG::2012-11-29 11:13:11,556::task::588::TaskManager.Task::(_updateState) Task=`41ab770e-bce6-40b0-94f9-c6da4743b0e0`::moving from state preparing -> state finished >Thread-285::DEBUG::2012-11-29 11:13:11,556::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-285::DEBUG::2012-11-29 11:13:11,556::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-285::DEBUG::2012-11-29 11:13:11,557::task::978::TaskManager.Task::(_decref) Task=`41ab770e-bce6-40b0-94f9-c6da4743b0e0`::ref 0 aborting False >Thread-283::DEBUG::2012-11-29 11:13:11,608::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-283::DEBUG::2012-11-29 11:13:11,609::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-283::INFO::2012-11-29 11:13:11,612::sp::1133::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 to /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-283::INFO::2012-11-29 11:13:11,613::sp::1133::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 to /rhev/data-center/21ea8081-3262-478a-8e4a-8e46b0e2fbc9/mastersd >Thread-283::DEBUG::2012-11-29 11:13:11,613::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-283::DEBUG::2012-11-29 11:13:11,614::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-283::DEBUG::2012-11-29 11:13:11,614::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-283::DEBUG::2012-11-29 11:13:11,614::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-283::INFO::2012-11-29 11:13:11,615::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-283::DEBUG::2012-11-29 11:13:11,615::task::1172::TaskManager.Task::(prepare) Task=`dca0fa3a-c55f-4403-a07a-a7b4b829fce6`::finished: True >Thread-283::DEBUG::2012-11-29 11:13:11,615::task::588::TaskManager.Task::(_updateState) Task=`dca0fa3a-c55f-4403-a07a-a7b4b829fce6`::moving from state preparing -> state finished >Thread-283::DEBUG::2012-11-29 11:13:11,616::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-283::DEBUG::2012-11-29 11:13:11,616::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-283::DEBUG::2012-11-29 11:13:11,616::task::978::TaskManager.Task::(_decref) Task=`dca0fa3a-c55f-4403-a07a-a7b4b829fce6`::ref 0 aborting False >Thread-292::DEBUG::2012-11-29 11:13:11,698::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-292::DEBUG::2012-11-29 11:13:11,699::task::588::TaskManager.Task::(_updateState) Task=`7c97aa4a-d059-40f1-86a4-c6c68a187576`::moving from state init -> state preparing >Thread-292::INFO::2012-11-29 11:13:11,699::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-292::INFO::2012-11-29 11:13:11,700::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-292::DEBUG::2012-11-29 11:13:11,700::task::1172::TaskManager.Task::(prepare) Task=`7c97aa4a-d059-40f1-86a4-c6c68a187576`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-292::DEBUG::2012-11-29 11:13:11,700::task::588::TaskManager.Task::(_updateState) Task=`7c97aa4a-d059-40f1-86a4-c6c68a187576`::moving from state preparing -> state finished >Thread-292::DEBUG::2012-11-29 11:13:11,700::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-292::DEBUG::2012-11-29 11:13:11,701::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-292::DEBUG::2012-11-29 11:13:11,701::task::978::TaskManager.Task::(_decref) Task=`7c97aa4a-d059-40f1-86a4-c6c68a187576`::ref 0 aborting False >Thread-293::DEBUG::2012-11-29 11:13:11,736::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-293::DEBUG::2012-11-29 11:13:11,737::task::588::TaskManager.Task::(_updateState) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::moving from state init -> state preparing >Thread-293::INFO::2012-11-29 11:13:11,737::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', prevID=-1, prevLVER='0', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-293::DEBUG::2012-11-29 11:13:11,738::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`5cd6e980-eece-4852-a8d8-fe79eec9ef2d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-293::DEBUG::2012-11-29 11:13:11,738::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-293::DEBUG::2012-11-29 11:13:11,738::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-293::DEBUG::2012-11-29 11:13:11,739::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`5cd6e980-eece-4852-a8d8-fe79eec9ef2d`::Granted request >Thread-293::DEBUG::2012-11-29 11:13:11,739::task::817::TaskManager.Task::(resourceAcquired) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (exclusive) >Thread-293::DEBUG::2012-11-29 11:13:11,739::task::978::TaskManager.Task::(_decref) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::ref 1 aborting False >Thread-293::INFO::2012-11-29 11:13:11,740::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-293::DEBUG::2012-11-29 11:13:11,740::task::1167::TaskManager.Task::(prepare) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::Prepare: 1 jobs exist, move to acquiring >Thread-293::DEBUG::2012-11-29 11:13:11,740::task::588::TaskManager.Task::(_updateState) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::moving from state preparing -> state acquiring >Thread-293::DEBUG::2012-11-29 11:13:11,741::task::588::TaskManager.Task::(_updateState) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::moving from state acquiring -> state queued >Thread-293::DEBUG::2012-11-29 11:13:11,741::taskManager::48::TaskManager::(_queueTask) queueing task: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-293::DEBUG::2012-11-29 11:13:11,741::taskManager::54::TaskManager::(_queueTask) task queued: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-10::DEBUG::2012-11-29 11:13:11,741::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-293::DEBUG::2012-11-29 11:13:11,741::task::1169::TaskManager.Task::(prepare) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::returning >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,742::threadPool::212::Misc.ThreadPool.WorkerThread::(run) Task: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 running: <bound method Task.commit of <storage.task.Task instance at 0x12b3170>> with: None >Thread-293::DEBUG::2012-11-29 11:13:11,742::task::978::TaskManager.Task::(_decref) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::ref 0 aborting False >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,743::task::1181::TaskManager.Task::(commit) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::Commiting task: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,743::task::588::TaskManager.Task::(_updateState) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::moving from state queued -> state running >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,744::task::892::TaskManager.Task::(_runJobs) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f5ab4466f10>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,744::task::317::TaskManager.Task::(run) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f5ab4466f10>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) callback None >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,744::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,745::misc::1046::SamplingMethod::(__call__) Got in to sampling method >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,747::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ee577cc6e3f8e646edc5c5f08f7251ecf32f0e69'] >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,747::misc::1054::SamplingMethod::(__call__) Returning last result >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:11,749::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ee577cc6e3f8e646edc5c5f08f7251ecf32f0e69'] >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::INFO::2012-11-29 11:13:11,750::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 1) >Thread-294::DEBUG::2012-11-29 11:13:12,775::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-294::DEBUG::2012-11-29 11:13:12,776::task::588::TaskManager.Task::(_updateState) Task=`954bd18a-e671-4787-b815-70ab7c729481`::moving from state init -> state preparing >Thread-294::INFO::2012-11-29 11:13:12,776::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-294::DEBUG::2012-11-29 11:13:12,776::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-294::DEBUG::2012-11-29 11:13:12,777::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-294::INFO::2012-11-29 11:13:12,777::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-294::DEBUG::2012-11-29 11:13:12,777::task::1172::TaskManager.Task::(prepare) Task=`954bd18a-e671-4787-b815-70ab7c729481`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-294::DEBUG::2012-11-29 11:13:12,778::task::588::TaskManager.Task::(_updateState) Task=`954bd18a-e671-4787-b815-70ab7c729481`::moving from state preparing -> state finished >Thread-294::DEBUG::2012-11-29 11:13:12,778::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-294::DEBUG::2012-11-29 11:13:12,778::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-294::DEBUG::2012-11-29 11:13:12,778::task::978::TaskManager.Task::(_decref) Task=`954bd18a-e671-4787-b815-70ab7c729481`::ref 0 aborting False >Thread-296::DEBUG::2012-11-29 11:13:13,806::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-296::DEBUG::2012-11-29 11:13:13,806::task::588::TaskManager.Task::(_updateState) Task=`7ff1ca29-b5cd-49a3-98dc-03f46824d586`::moving from state init -> state preparing >Thread-296::INFO::2012-11-29 11:13:13,807::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-296::DEBUG::2012-11-29 11:13:13,807::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-296::DEBUG::2012-11-29 11:13:13,807::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-296::INFO::2012-11-29 11:13:13,807::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-296::DEBUG::2012-11-29 11:13:13,808::task::1172::TaskManager.Task::(prepare) Task=`7ff1ca29-b5cd-49a3-98dc-03f46824d586`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-296::DEBUG::2012-11-29 11:13:13,808::task::588::TaskManager.Task::(_updateState) Task=`7ff1ca29-b5cd-49a3-98dc-03f46824d586`::moving from state preparing -> state finished >Thread-296::DEBUG::2012-11-29 11:13:13,808::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-296::DEBUG::2012-11-29 11:13:13,809::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-296::DEBUG::2012-11-29 11:13:13,809::task::978::TaskManager.Task::(_decref) Task=`7ff1ca29-b5cd-49a3-98dc-03f46824d586`::ref 0 aborting False >Thread-297::DEBUG::2012-11-29 11:13:14,843::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-297::DEBUG::2012-11-29 11:13:14,844::task::588::TaskManager.Task::(_updateState) Task=`27345107-5a85-49ca-a774-f1a46d0fd127`::moving from state init -> state preparing >Thread-297::INFO::2012-11-29 11:13:14,844::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-297::DEBUG::2012-11-29 11:13:14,844::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-297::DEBUG::2012-11-29 11:13:14,845::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-297::INFO::2012-11-29 11:13:14,845::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-297::DEBUG::2012-11-29 11:13:14,845::task::1172::TaskManager.Task::(prepare) Task=`27345107-5a85-49ca-a774-f1a46d0fd127`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-297::DEBUG::2012-11-29 11:13:14,845::task::588::TaskManager.Task::(_updateState) Task=`27345107-5a85-49ca-a774-f1a46d0fd127`::moving from state preparing -> state finished >Thread-297::DEBUG::2012-11-29 11:13:14,846::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-297::DEBUG::2012-11-29 11:13:14,846::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-297::DEBUG::2012-11-29 11:13:14,846::task::978::TaskManager.Task::(_decref) Task=`27345107-5a85-49ca-a774-f1a46d0fd127`::ref 0 aborting False >Thread-299::DEBUG::2012-11-29 11:13:15,875::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-299::DEBUG::2012-11-29 11:13:15,876::task::588::TaskManager.Task::(_updateState) Task=`2472ac89-9efb-425a-8dc9-c89bc0ac4125`::moving from state init -> state preparing >Thread-299::INFO::2012-11-29 11:13:15,876::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-299::DEBUG::2012-11-29 11:13:15,876::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-299::DEBUG::2012-11-29 11:13:15,876::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-299::INFO::2012-11-29 11:13:15,877::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-299::DEBUG::2012-11-29 11:13:15,877::task::1172::TaskManager.Task::(prepare) Task=`2472ac89-9efb-425a-8dc9-c89bc0ac4125`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-299::DEBUG::2012-11-29 11:13:15,877::task::588::TaskManager.Task::(_updateState) Task=`2472ac89-9efb-425a-8dc9-c89bc0ac4125`::moving from state preparing -> state finished >Thread-299::DEBUG::2012-11-29 11:13:15,878::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-299::DEBUG::2012-11-29 11:13:15,878::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-299::DEBUG::2012-11-29 11:13:15,878::task::978::TaskManager.Task::(_decref) Task=`2472ac89-9efb-425a-8dc9-c89bc0ac4125`::ref 0 aborting False >Thread-300::DEBUG::2012-11-29 11:13:16,910::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-300::DEBUG::2012-11-29 11:13:16,911::task::588::TaskManager.Task::(_updateState) Task=`a0c4729a-207b-4a41-b7ea-dd40b26c6fe8`::moving from state init -> state preparing >Thread-300::INFO::2012-11-29 11:13:16,911::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-300::DEBUG::2012-11-29 11:13:16,912::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-300::DEBUG::2012-11-29 11:13:16,912::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-300::INFO::2012-11-29 11:13:16,912::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-300::DEBUG::2012-11-29 11:13:16,912::task::1172::TaskManager.Task::(prepare) Task=`a0c4729a-207b-4a41-b7ea-dd40b26c6fe8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-300::DEBUG::2012-11-29 11:13:16,913::task::588::TaskManager.Task::(_updateState) Task=`a0c4729a-207b-4a41-b7ea-dd40b26c6fe8`::moving from state preparing -> state finished >Thread-300::DEBUG::2012-11-29 11:13:16,913::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-300::DEBUG::2012-11-29 11:13:16,913::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-300::DEBUG::2012-11-29 11:13:16,914::task::978::TaskManager.Task::(_decref) Task=`a0c4729a-207b-4a41-b7ea-dd40b26c6fe8`::ref 0 aborting False >Thread-302::DEBUG::2012-11-29 11:13:17,944::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-302::DEBUG::2012-11-29 11:13:17,945::task::588::TaskManager.Task::(_updateState) Task=`d6793352-6148-4e0f-83f2-ceb9b8180327`::moving from state init -> state preparing >Thread-302::INFO::2012-11-29 11:13:17,945::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-302::DEBUG::2012-11-29 11:13:17,945::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-302::DEBUG::2012-11-29 11:13:17,945::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-302::INFO::2012-11-29 11:13:17,946::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-302::DEBUG::2012-11-29 11:13:17,946::task::1172::TaskManager.Task::(prepare) Task=`d6793352-6148-4e0f-83f2-ceb9b8180327`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-302::DEBUG::2012-11-29 11:13:17,946::task::588::TaskManager.Task::(_updateState) Task=`d6793352-6148-4e0f-83f2-ceb9b8180327`::moving from state preparing -> state finished >Thread-302::DEBUG::2012-11-29 11:13:17,947::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-302::DEBUG::2012-11-29 11:13:17,947::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-302::DEBUG::2012-11-29 11:13:17,947::task::978::TaskManager.Task::(_decref) Task=`d6793352-6148-4e0f-83f2-ceb9b8180327`::ref 0 aborting False >Thread-303::DEBUG::2012-11-29 11:13:18,977::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-303::DEBUG::2012-11-29 11:13:18,978::task::588::TaskManager.Task::(_updateState) Task=`8fab5968-e40f-4e11-bdde-7f0ad70625af`::moving from state init -> state preparing >Thread-303::INFO::2012-11-29 11:13:18,978::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-303::DEBUG::2012-11-29 11:13:18,978::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-303::DEBUG::2012-11-29 11:13:18,978::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-303::INFO::2012-11-29 11:13:18,979::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-303::DEBUG::2012-11-29 11:13:18,979::task::1172::TaskManager.Task::(prepare) Task=`8fab5968-e40f-4e11-bdde-7f0ad70625af`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-303::DEBUG::2012-11-29 11:13:18,979::task::588::TaskManager.Task::(_updateState) Task=`8fab5968-e40f-4e11-bdde-7f0ad70625af`::moving from state preparing -> state finished >Thread-303::DEBUG::2012-11-29 11:13:18,980::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-303::DEBUG::2012-11-29 11:13:18,980::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-303::DEBUG::2012-11-29 11:13:18,980::task::978::TaskManager.Task::(_decref) Task=`8fab5968-e40f-4e11-bdde-7f0ad70625af`::ref 0 aborting False >Thread-305::DEBUG::2012-11-29 11:13:20,019::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-305::DEBUG::2012-11-29 11:13:20,020::task::588::TaskManager.Task::(_updateState) Task=`4e46da2a-6108-4ca3-8a01-2a6854e2cbeb`::moving from state init -> state preparing >Thread-305::INFO::2012-11-29 11:13:20,020::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-305::DEBUG::2012-11-29 11:13:20,020::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-305::DEBUG::2012-11-29 11:13:20,021::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-305::INFO::2012-11-29 11:13:20,021::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-305::DEBUG::2012-11-29 11:13:20,021::task::1172::TaskManager.Task::(prepare) Task=`4e46da2a-6108-4ca3-8a01-2a6854e2cbeb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-305::DEBUG::2012-11-29 11:13:20,021::task::588::TaskManager.Task::(_updateState) Task=`4e46da2a-6108-4ca3-8a01-2a6854e2cbeb`::moving from state preparing -> state finished >Thread-305::DEBUG::2012-11-29 11:13:20,022::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-305::DEBUG::2012-11-29 11:13:20,022::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-305::DEBUG::2012-11-29 11:13:20,022::task::978::TaskManager.Task::(_decref) Task=`4e46da2a-6108-4ca3-8a01-2a6854e2cbeb`::ref 0 aborting False >Thread-306::DEBUG::2012-11-29 11:13:21,050::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-306::DEBUG::2012-11-29 11:13:21,051::task::588::TaskManager.Task::(_updateState) Task=`4d2e3501-435a-4884-8b97-b753cf93dda8`::moving from state init -> state preparing >Thread-306::INFO::2012-11-29 11:13:21,051::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-306::DEBUG::2012-11-29 11:13:21,051::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-306::DEBUG::2012-11-29 11:13:21,051::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-306::INFO::2012-11-29 11:13:21,052::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-306::DEBUG::2012-11-29 11:13:21,052::task::1172::TaskManager.Task::(prepare) Task=`4d2e3501-435a-4884-8b97-b753cf93dda8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-306::DEBUG::2012-11-29 11:13:21,052::task::588::TaskManager.Task::(_updateState) Task=`4d2e3501-435a-4884-8b97-b753cf93dda8`::moving from state preparing -> state finished >Thread-306::DEBUG::2012-11-29 11:13:21,053::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-306::DEBUG::2012-11-29 11:13:21,053::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-306::DEBUG::2012-11-29 11:13:21,053::task::978::TaskManager.Task::(_decref) Task=`4d2e3501-435a-4884-8b97-b753cf93dda8`::ref 0 aborting False >Thread-307::DEBUG::2012-11-29 11:13:21,763::task::588::TaskManager.Task::(_updateState) Task=`78f7bcca-8e1c-402a-a1d7-db85ea4cfeeb`::moving from state init -> state preparing >Thread-307::INFO::2012-11-29 11:13:21,764::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-307::INFO::2012-11-29 11:13:21,764::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00462293624878', 'lastCheck': '10.3', 'code': 0, 'valid': True}} >Thread-307::DEBUG::2012-11-29 11:13:21,764::task::1172::TaskManager.Task::(prepare) Task=`78f7bcca-8e1c-402a-a1d7-db85ea4cfeeb`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00462293624878', 'lastCheck': '10.3', 'code': 0, 'valid': True}} >Thread-307::DEBUG::2012-11-29 11:13:21,765::task::588::TaskManager.Task::(_updateState) Task=`78f7bcca-8e1c-402a-a1d7-db85ea4cfeeb`::moving from state preparing -> state finished >Thread-307::DEBUG::2012-11-29 11:13:21,765::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-307::DEBUG::2012-11-29 11:13:21,765::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-307::DEBUG::2012-11-29 11:13:21,766::task::978::TaskManager.Task::(_decref) Task=`78f7bcca-8e1c-402a-a1d7-db85ea4cfeeb`::ref 0 aborting False >Thread-309::DEBUG::2012-11-29 11:13:22,094::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-309::DEBUG::2012-11-29 11:13:22,094::task::588::TaskManager.Task::(_updateState) Task=`5324c3c1-5069-4e77-876a-a3cec17f4144`::moving from state init -> state preparing >Thread-309::INFO::2012-11-29 11:13:22,094::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-309::DEBUG::2012-11-29 11:13:22,095::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-309::DEBUG::2012-11-29 11:13:22,095::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-309::INFO::2012-11-29 11:13:22,095::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-309::DEBUG::2012-11-29 11:13:22,096::task::1172::TaskManager.Task::(prepare) Task=`5324c3c1-5069-4e77-876a-a3cec17f4144`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-309::DEBUG::2012-11-29 11:13:22,096::task::588::TaskManager.Task::(_updateState) Task=`5324c3c1-5069-4e77-876a-a3cec17f4144`::moving from state preparing -> state finished >Thread-309::DEBUG::2012-11-29 11:13:22,096::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-309::DEBUG::2012-11-29 11:13:22,096::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-309::DEBUG::2012-11-29 11:13:22,097::task::978::TaskManager.Task::(_decref) Task=`5324c3c1-5069-4e77-876a-a3cec17f4144`::ref 0 aborting False >Thread-310::DEBUG::2012-11-29 11:13:23,125::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-310::DEBUG::2012-11-29 11:13:23,125::task::588::TaskManager.Task::(_updateState) Task=`bb56c659-acb7-488b-98a2-b08b3375147c`::moving from state init -> state preparing >Thread-310::INFO::2012-11-29 11:13:23,126::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-310::DEBUG::2012-11-29 11:13:23,126::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-310::DEBUG::2012-11-29 11:13:23,126::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-310::INFO::2012-11-29 11:13:23,127::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-310::DEBUG::2012-11-29 11:13:23,127::task::1172::TaskManager.Task::(prepare) Task=`bb56c659-acb7-488b-98a2-b08b3375147c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-310::DEBUG::2012-11-29 11:13:23,127::task::588::TaskManager.Task::(_updateState) Task=`bb56c659-acb7-488b-98a2-b08b3375147c`::moving from state preparing -> state finished >Thread-310::DEBUG::2012-11-29 11:13:23,127::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-310::DEBUG::2012-11-29 11:13:23,128::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-310::DEBUG::2012-11-29 11:13:23,128::task::978::TaskManager.Task::(_decref) Task=`bb56c659-acb7-488b-98a2-b08b3375147c`::ref 0 aborting False >Thread-312::DEBUG::2012-11-29 11:13:24,155::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-312::DEBUG::2012-11-29 11:13:24,156::task::588::TaskManager.Task::(_updateState) Task=`2d8053e9-329c-43be-bc73-ebc43f6ebc7b`::moving from state init -> state preparing >Thread-312::INFO::2012-11-29 11:13:24,156::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-312::DEBUG::2012-11-29 11:13:24,156::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-312::DEBUG::2012-11-29 11:13:24,157::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-312::INFO::2012-11-29 11:13:24,157::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-312::DEBUG::2012-11-29 11:13:24,157::task::1172::TaskManager.Task::(prepare) Task=`2d8053e9-329c-43be-bc73-ebc43f6ebc7b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-312::DEBUG::2012-11-29 11:13:24,157::task::588::TaskManager.Task::(_updateState) Task=`2d8053e9-329c-43be-bc73-ebc43f6ebc7b`::moving from state preparing -> state finished >Thread-312::DEBUG::2012-11-29 11:13:24,158::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-312::DEBUG::2012-11-29 11:13:24,158::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-312::DEBUG::2012-11-29 11:13:24,158::task::978::TaskManager.Task::(_decref) Task=`2d8053e9-329c-43be-bc73-ebc43f6ebc7b`::ref 0 aborting False >Thread-313::DEBUG::2012-11-29 11:13:25,186::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-313::DEBUG::2012-11-29 11:13:25,187::task::588::TaskManager.Task::(_updateState) Task=`71439cdb-b18f-44ae-9683-7988bdb09649`::moving from state init -> state preparing >Thread-313::INFO::2012-11-29 11:13:25,187::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-313::DEBUG::2012-11-29 11:13:25,187::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-313::DEBUG::2012-11-29 11:13:25,188::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-313::INFO::2012-11-29 11:13:25,188::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-313::DEBUG::2012-11-29 11:13:25,188::task::1172::TaskManager.Task::(prepare) Task=`71439cdb-b18f-44ae-9683-7988bdb09649`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-313::DEBUG::2012-11-29 11:13:25,189::task::588::TaskManager.Task::(_updateState) Task=`71439cdb-b18f-44ae-9683-7988bdb09649`::moving from state preparing -> state finished >Thread-313::DEBUG::2012-11-29 11:13:25,189::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-313::DEBUG::2012-11-29 11:13:25,189::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-313::DEBUG::2012-11-29 11:13:25,189::task::978::TaskManager.Task::(_decref) Task=`71439cdb-b18f-44ae-9683-7988bdb09649`::ref 0 aborting False >Thread-315::DEBUG::2012-11-29 11:13:26,216::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-315::DEBUG::2012-11-29 11:13:26,217::task::588::TaskManager.Task::(_updateState) Task=`722c21dc-d89d-4130-b6ed-cf544a3ebe3a`::moving from state init -> state preparing >Thread-315::INFO::2012-11-29 11:13:26,217::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-315::DEBUG::2012-11-29 11:13:26,217::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-315::DEBUG::2012-11-29 11:13:26,218::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-315::INFO::2012-11-29 11:13:26,218::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-315::DEBUG::2012-11-29 11:13:26,218::task::1172::TaskManager.Task::(prepare) Task=`722c21dc-d89d-4130-b6ed-cf544a3ebe3a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-315::DEBUG::2012-11-29 11:13:26,218::task::588::TaskManager.Task::(_updateState) Task=`722c21dc-d89d-4130-b6ed-cf544a3ebe3a`::moving from state preparing -> state finished >Thread-315::DEBUG::2012-11-29 11:13:26,219::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-315::DEBUG::2012-11-29 11:13:26,219::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-315::DEBUG::2012-11-29 11:13:26,219::task::978::TaskManager.Task::(_decref) Task=`722c21dc-d89d-4130-b6ed-cf544a3ebe3a`::ref 0 aborting False >Thread-316::DEBUG::2012-11-29 11:13:27,247::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-316::DEBUG::2012-11-29 11:13:27,247::task::588::TaskManager.Task::(_updateState) Task=`526ea365-a7d1-4187-b5cd-7c023e71b8b2`::moving from state init -> state preparing >Thread-316::INFO::2012-11-29 11:13:27,248::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-316::DEBUG::2012-11-29 11:13:27,248::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-316::DEBUG::2012-11-29 11:13:27,248::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-316::INFO::2012-11-29 11:13:27,249::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-316::DEBUG::2012-11-29 11:13:27,249::task::1172::TaskManager.Task::(prepare) Task=`526ea365-a7d1-4187-b5cd-7c023e71b8b2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-316::DEBUG::2012-11-29 11:13:27,249::task::588::TaskManager.Task::(_updateState) Task=`526ea365-a7d1-4187-b5cd-7c023e71b8b2`::moving from state preparing -> state finished >Thread-316::DEBUG::2012-11-29 11:13:27,249::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-316::DEBUG::2012-11-29 11:13:27,250::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-316::DEBUG::2012-11-29 11:13:27,250::task::978::TaskManager.Task::(_decref) Task=`526ea365-a7d1-4187-b5cd-7c023e71b8b2`::ref 0 aborting False >Thread-318::DEBUG::2012-11-29 11:13:28,277::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-318::DEBUG::2012-11-29 11:13:28,277::task::588::TaskManager.Task::(_updateState) Task=`2fdca18f-9d49-4282-90db-7f490f687745`::moving from state init -> state preparing >Thread-318::INFO::2012-11-29 11:13:28,278::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-318::DEBUG::2012-11-29 11:13:28,278::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-318::DEBUG::2012-11-29 11:13:28,278::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-318::INFO::2012-11-29 11:13:28,279::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-318::DEBUG::2012-11-29 11:13:28,279::task::1172::TaskManager.Task::(prepare) Task=`2fdca18f-9d49-4282-90db-7f490f687745`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-318::DEBUG::2012-11-29 11:13:28,279::task::588::TaskManager.Task::(_updateState) Task=`2fdca18f-9d49-4282-90db-7f490f687745`::moving from state preparing -> state finished >Thread-318::DEBUG::2012-11-29 11:13:28,279::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-318::DEBUG::2012-11-29 11:13:28,280::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-318::DEBUG::2012-11-29 11:13:28,280::task::978::TaskManager.Task::(_decref) Task=`2fdca18f-9d49-4282-90db-7f490f687745`::ref 0 aborting False >Thread-319::DEBUG::2012-11-29 11:13:29,308::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-319::DEBUG::2012-11-29 11:13:29,308::task::588::TaskManager.Task::(_updateState) Task=`f08f4f62-4196-4026-aa43-c532e4272327`::moving from state init -> state preparing >Thread-319::INFO::2012-11-29 11:13:29,309::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-319::DEBUG::2012-11-29 11:13:29,309::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-319::DEBUG::2012-11-29 11:13:29,309::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-319::INFO::2012-11-29 11:13:29,309::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-319::DEBUG::2012-11-29 11:13:29,310::task::1172::TaskManager.Task::(prepare) Task=`f08f4f62-4196-4026-aa43-c532e4272327`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-319::DEBUG::2012-11-29 11:13:29,310::task::588::TaskManager.Task::(_updateState) Task=`f08f4f62-4196-4026-aa43-c532e4272327`::moving from state preparing -> state finished >Thread-319::DEBUG::2012-11-29 11:13:29,310::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-319::DEBUG::2012-11-29 11:13:29,311::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-319::DEBUG::2012-11-29 11:13:29,311::task::978::TaskManager.Task::(_decref) Task=`f08f4f62-4196-4026-aa43-c532e4272327`::ref 0 aborting False >Thread-321::DEBUG::2012-11-29 11:13:30,339::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-321::DEBUG::2012-11-29 11:13:30,339::task::588::TaskManager.Task::(_updateState) Task=`1c609d5f-6010-441f-b18c-8ea43b035bef`::moving from state init -> state preparing >Thread-321::INFO::2012-11-29 11:13:30,339::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-321::DEBUG::2012-11-29 11:13:30,340::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-321::DEBUG::2012-11-29 11:13:30,340::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-321::INFO::2012-11-29 11:13:30,340::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-321::DEBUG::2012-11-29 11:13:30,341::task::1172::TaskManager.Task::(prepare) Task=`1c609d5f-6010-441f-b18c-8ea43b035bef`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-321::DEBUG::2012-11-29 11:13:30,341::task::588::TaskManager.Task::(_updateState) Task=`1c609d5f-6010-441f-b18c-8ea43b035bef`::moving from state preparing -> state finished >Thread-321::DEBUG::2012-11-29 11:13:30,341::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-321::DEBUG::2012-11-29 11:13:30,341::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-321::DEBUG::2012-11-29 11:13:30,342::task::978::TaskManager.Task::(_decref) Task=`1c609d5f-6010-441f-b18c-8ea43b035bef`::ref 0 aborting False >Thread-322::DEBUG::2012-11-29 11:13:31,369::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-322::DEBUG::2012-11-29 11:13:31,370::task::588::TaskManager.Task::(_updateState) Task=`c78286e0-eded-413c-a0a7-c58ce7e8919f`::moving from state init -> state preparing >Thread-322::INFO::2012-11-29 11:13:31,370::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-322::DEBUG::2012-11-29 11:13:31,370::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-322::DEBUG::2012-11-29 11:13:31,371::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-322::INFO::2012-11-29 11:13:31,371::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-322::DEBUG::2012-11-29 11:13:31,371::task::1172::TaskManager.Task::(prepare) Task=`c78286e0-eded-413c-a0a7-c58ce7e8919f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-322::DEBUG::2012-11-29 11:13:31,372::task::588::TaskManager.Task::(_updateState) Task=`c78286e0-eded-413c-a0a7-c58ce7e8919f`::moving from state preparing -> state finished >Thread-322::DEBUG::2012-11-29 11:13:31,372::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-322::DEBUG::2012-11-29 11:13:31,372::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-322::DEBUG::2012-11-29 11:13:31,372::task::978::TaskManager.Task::(_decref) Task=`c78286e0-eded-413c-a0a7-c58ce7e8919f`::ref 0 aborting False >Thread-323::DEBUG::2012-11-29 11:13:31,963::task::588::TaskManager.Task::(_updateState) Task=`c74f0561-e12a-44a6-9bbb-a88fe2096128`::moving from state init -> state preparing >Thread-323::INFO::2012-11-29 11:13:31,963::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-323::INFO::2012-11-29 11:13:31,963::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00462293624878', 'lastCheck': '20.5', 'code': 0, 'valid': True}} >Thread-323::DEBUG::2012-11-29 11:13:31,964::task::1172::TaskManager.Task::(prepare) Task=`c74f0561-e12a-44a6-9bbb-a88fe2096128`::finished: {'f1008a0c-010a-45a0-b80c-f5e8514a76e7': {'delay': '0.00462293624878', 'lastCheck': '20.5', 'code': 0, 'valid': True}} >Thread-323::DEBUG::2012-11-29 11:13:31,964::task::588::TaskManager.Task::(_updateState) Task=`c74f0561-e12a-44a6-9bbb-a88fe2096128`::moving from state preparing -> state finished >Thread-323::DEBUG::2012-11-29 11:13:31,964::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-323::DEBUG::2012-11-29 11:13:31,964::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-323::DEBUG::2012-11-29 11:13:31,965::task::978::TaskManager.Task::(_decref) Task=`c74f0561-e12a-44a6-9bbb-a88fe2096128`::ref 0 aborting False >Thread-325::DEBUG::2012-11-29 11:13:32,401::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-325::DEBUG::2012-11-29 11:13:32,401::task::588::TaskManager.Task::(_updateState) Task=`cb6e6b9e-b553-4853-a3b0-f05e8584bee4`::moving from state init -> state preparing >Thread-325::INFO::2012-11-29 11:13:32,402::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-325::DEBUG::2012-11-29 11:13:32,402::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-325::DEBUG::2012-11-29 11:13:32,402::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-325::INFO::2012-11-29 11:13:32,402::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-325::DEBUG::2012-11-29 11:13:32,403::task::1172::TaskManager.Task::(prepare) Task=`cb6e6b9e-b553-4853-a3b0-f05e8584bee4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-325::DEBUG::2012-11-29 11:13:32,403::task::588::TaskManager.Task::(_updateState) Task=`cb6e6b9e-b553-4853-a3b0-f05e8584bee4`::moving from state preparing -> state finished >Thread-325::DEBUG::2012-11-29 11:13:32,403::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-325::DEBUG::2012-11-29 11:13:32,404::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-325::DEBUG::2012-11-29 11:13:32,404::task::978::TaskManager.Task::(_decref) Task=`cb6e6b9e-b553-4853-a3b0-f05e8584bee4`::ref 0 aborting False >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,758::safelease::178::SANLock::(acquireHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully acquired (id: 1) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::INFO::2012-11-29 11:13:32,759::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 1) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,795::safelease::235::SANLock::(acquire) Cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully acquired (id: 1) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,795::sp::263::Storage.StoragePool::(startSpm) spm lock acquired successfully >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,797::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ee577cc6e3f8e646edc5c5f08f7251ecf32f0e69'] >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,797::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,798::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,798::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5eb992dc11188c171a1bc8225c00ee0110892a10'] >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,801::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,802::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`8186c15c-f431-483f-bc3e-2b8b59a0bbb2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,802::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,802::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,803::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`8186c15c-f431-483f-bc3e-2b8b59a0bbb2`::Granted request >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::INFO::2012-11-29 11:13:32,803::sp::412::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `f1008a0c-010a-45a0-b80c-f5e8514a76e7` >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,804::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`4c5321d4-c691-4c10-9a98-c5d8380c634c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,804::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'exclusive' >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,804::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'exclusive' (1 active user) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,804::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`4c5321d4-c691-4c10-9a98-c5d8380c634c`::Granted request >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,805::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,805::misc::1046::SamplingMethod::(__call__) Got in to sampling method >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,806::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,806::misc::1046::SamplingMethod::(__call__) Got in to sampling method >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,806::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,816::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,817::misc::1054::SamplingMethod::(__call__) Returning last result >MainProcess|4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:32,818::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-326::DEBUG::2012-11-29 11:13:33,432::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-326::DEBUG::2012-11-29 11:13:33,433::task::588::TaskManager.Task::(_updateState) Task=`d85a672b-0812-4b37-814e-69160fbd2662`::moving from state init -> state preparing >Thread-326::INFO::2012-11-29 11:13:33,433::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-326::DEBUG::2012-11-29 11:13:33,434::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-326::DEBUG::2012-11-29 11:13:33,434::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-326::INFO::2012-11-29 11:13:33,434::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-326::DEBUG::2012-11-29 11:13:33,434::task::1172::TaskManager.Task::(prepare) Task=`d85a672b-0812-4b37-814e-69160fbd2662`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-326::DEBUG::2012-11-29 11:13:33,435::task::588::TaskManager.Task::(_updateState) Task=`d85a672b-0812-4b37-814e-69160fbd2662`::moving from state preparing -> state finished >Thread-326::DEBUG::2012-11-29 11:13:33,435::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-326::DEBUG::2012-11-29 11:13:33,435::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-326::DEBUG::2012-11-29 11:13:33,436::task::978::TaskManager.Task::(_decref) Task=`d85a672b-0812-4b37-814e-69160fbd2662`::ref 0 aborting False >MainProcess|4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:33,822::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >Thread-328::DEBUG::2012-11-29 11:13:34,464::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-328::DEBUG::2012-11-29 11:13:34,465::task::588::TaskManager.Task::(_updateState) Task=`d292ee63-c418-4a17-9baf-d5dacf92ac64`::moving from state init -> state preparing >Thread-328::INFO::2012-11-29 11:13:34,465::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-328::DEBUG::2012-11-29 11:13:34,465::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-328::DEBUG::2012-11-29 11:13:34,466::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-328::INFO::2012-11-29 11:13:34,466::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-328::DEBUG::2012-11-29 11:13:34,466::task::1172::TaskManager.Task::(prepare) Task=`d292ee63-c418-4a17-9baf-d5dacf92ac64`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-328::DEBUG::2012-11-29 11:13:34,466::task::588::TaskManager.Task::(_updateState) Task=`d292ee63-c418-4a17-9baf-d5dacf92ac64`::moving from state preparing -> state finished >Thread-328::DEBUG::2012-11-29 11:13:34,467::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-328::DEBUG::2012-11-29 11:13:34,467::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-328::DEBUG::2012-11-29 11:13:34,467::task::978::TaskManager.Task::(_decref) Task=`d292ee63-c418-4a17-9baf-d5dacf92ac64`::ref 0 aborting False >MainProcess|4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:34,826::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-329::DEBUG::2012-11-29 11:13:35,495::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-329::DEBUG::2012-11-29 11:13:35,496::task::588::TaskManager.Task::(_updateState) Task=`d381e31e-0081-4f25-b88a-7bc736de83a3`::moving from state init -> state preparing >Thread-329::INFO::2012-11-29 11:13:35,496::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-329::DEBUG::2012-11-29 11:13:35,496::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-329::DEBUG::2012-11-29 11:13:35,497::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-329::INFO::2012-11-29 11:13:35,497::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-329::DEBUG::2012-11-29 11:13:35,497::task::1172::TaskManager.Task::(prepare) Task=`d381e31e-0081-4f25-b88a-7bc736de83a3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-329::DEBUG::2012-11-29 11:13:35,498::task::588::TaskManager.Task::(_updateState) Task=`d381e31e-0081-4f25-b88a-7bc736de83a3`::moving from state preparing -> state finished >Thread-329::DEBUG::2012-11-29 11:13:35,498::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-329::DEBUG::2012-11-29 11:13:35,498::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-329::DEBUG::2012-11-29 11:13:35,498::task::978::TaskManager.Task::(_decref) Task=`d381e31e-0081-4f25-b88a-7bc736de83a3`::ref 0 aborting False >MainProcess|4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:35,830::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:35,832::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:35,834::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >Thread-331::DEBUG::2012-11-29 11:13:36,526::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-331::DEBUG::2012-11-29 11:13:36,527::task::588::TaskManager.Task::(_updateState) Task=`ab028eb1-e9d1-41f2-84da-eaa2112ddfc8`::moving from state init -> state preparing >Thread-331::INFO::2012-11-29 11:13:36,527::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-331::DEBUG::2012-11-29 11:13:36,528::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-331::DEBUG::2012-11-29 11:13:36,528::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-331::INFO::2012-11-29 11:13:36,528::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-331::DEBUG::2012-11-29 11:13:36,528::task::1172::TaskManager.Task::(prepare) Task=`ab028eb1-e9d1-41f2-84da-eaa2112ddfc8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-331::DEBUG::2012-11-29 11:13:36,529::task::588::TaskManager.Task::(_updateState) Task=`ab028eb1-e9d1-41f2-84da-eaa2112ddfc8`::moving from state preparing -> state finished >Thread-331::DEBUG::2012-11-29 11:13:36,529::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-331::DEBUG::2012-11-29 11:13:36,529::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-331::DEBUG::2012-11-29 11:13:36,530::task::978::TaskManager.Task::(_decref) Task=`ab028eb1-e9d1-41f2-84da-eaa2112ddfc8`::ref 0 aborting False >MainProcess|4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:36,837::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-332::DEBUG::2012-11-29 11:13:37,558::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-332::DEBUG::2012-11-29 11:13:37,559::task::588::TaskManager.Task::(_updateState) Task=`bd4bbdf5-f6f2-459b-883c-ed8385d40903`::moving from state init -> state preparing >Thread-332::INFO::2012-11-29 11:13:37,559::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-332::DEBUG::2012-11-29 11:13:37,559::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-332::DEBUG::2012-11-29 11:13:37,559::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-332::INFO::2012-11-29 11:13:37,560::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-332::DEBUG::2012-11-29 11:13:37,560::task::1172::TaskManager.Task::(prepare) Task=`bd4bbdf5-f6f2-459b-883c-ed8385d40903`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-332::DEBUG::2012-11-29 11:13:37,560::task::588::TaskManager.Task::(_updateState) Task=`bd4bbdf5-f6f2-459b-883c-ed8385d40903`::moving from state preparing -> state finished >Thread-332::DEBUG::2012-11-29 11:13:37,561::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-332::DEBUG::2012-11-29 11:13:37,561::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-332::DEBUG::2012-11-29 11:13:37,561::task::978::TaskManager.Task::(_decref) Task=`bd4bbdf5-f6f2-459b-883c-ed8385d40903`::ref 0 aborting False >Thread-334::DEBUG::2012-11-29 11:13:38,590::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-334::DEBUG::2012-11-29 11:13:38,590::task::588::TaskManager.Task::(_updateState) Task=`7fb90a47-b742-4a22-be37-fbca6e635b46`::moving from state init -> state preparing >Thread-334::INFO::2012-11-29 11:13:38,591::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-334::DEBUG::2012-11-29 11:13:38,591::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-334::DEBUG::2012-11-29 11:13:38,591::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-334::INFO::2012-11-29 11:13:38,591::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-334::DEBUG::2012-11-29 11:13:38,592::task::1172::TaskManager.Task::(prepare) Task=`7fb90a47-b742-4a22-be37-fbca6e635b46`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-334::DEBUG::2012-11-29 11:13:38,592::task::588::TaskManager.Task::(_updateState) Task=`7fb90a47-b742-4a22-be37-fbca6e635b46`::moving from state preparing -> state finished >Thread-334::DEBUG::2012-11-29 11:13:38,592::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-334::DEBUG::2012-11-29 11:13:38,592::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-334::DEBUG::2012-11-29 11:13:38,593::task::978::TaskManager.Task::(_decref) Task=`7fb90a47-b742-4a22-be37-fbca6e635b46`::ref 0 aborting False >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,841::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,871::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,871::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,872::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,872::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,873::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,873::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,873::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,873::misc::1054::SamplingMethod::(__call__) Returning last result >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,874::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:38,875::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free f1008a0c-010a-45a0-b80c-f5e8514a76e7' (cwd None) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,005::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = ' Volume group "f1008a0c-010a-45a0-b80c-f5e8514a76e7" not found\n'; <rc> = 5 >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::WARNING::2012-11-29 11:13:39,006::lvm::356::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "f1008a0c-010a-45a0-b80c-f5e8514a76e7" not found'] >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,006::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,012::fileSD::124::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,012::persistentDict::185::Storage.PersistentDict::(__init__) Created a persistant dict with FileMetadataRW backend >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,015::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=f1008a0c-010a-45a0-b80c-f5e8514a76e7:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5eb992dc11188c171a1bc8225c00ee0110892a10'] >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,017::fileSD::447::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::WARNING::2012-11-29 11:13:39,017::sd::321::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS already registered >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::WARNING::2012-11-29 11:13:39,017::sd::327::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS already registered >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,018::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,018::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,019::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,019::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,019::sp::416::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,019::sp::423::Storage.StoragePool::(_upgradePool) Registering with state change event >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,020::sp::425::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,020::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,020::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,021::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,021::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,022::sp::313::Storage.StoragePool::(startSpm) ended. >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,023::task::588::TaskManager.Task::(_updateState) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::moving from state running -> state finished >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,023::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>} >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,023::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,024::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,024::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,024::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,025::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,025::task::900::TaskManager.Task::(_runJobs) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::Task.run: exit - success: result >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,025::task::978::TaskManager.Task::(_decref) Task=`4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217`::ref 0 aborting False >4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217::DEBUG::2012-11-29 11:13:39,026::threadPool::67::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-340::DEBUG::2012-11-29 11:13:39,621::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-340::DEBUG::2012-11-29 11:13:39,622::task::588::TaskManager.Task::(_updateState) Task=`673cdfd6-7345-4688-827d-6b6aac4c3ae5`::moving from state init -> state preparing >Thread-340::INFO::2012-11-29 11:13:39,622::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-340::DEBUG::2012-11-29 11:13:39,622::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-340::DEBUG::2012-11-29 11:13:39,623::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'} >Thread-340::INFO::2012-11-29 11:13:39,623::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-340::DEBUG::2012-11-29 11:13:39,623::task::1172::TaskManager.Task::(prepare) Task=`673cdfd6-7345-4688-827d-6b6aac4c3ae5`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217'}} >Thread-340::DEBUG::2012-11-29 11:13:39,623::task::588::TaskManager.Task::(_updateState) Task=`673cdfd6-7345-4688-827d-6b6aac4c3ae5`::moving from state preparing -> state finished >Thread-340::DEBUG::2012-11-29 11:13:39,624::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-340::DEBUG::2012-11-29 11:13:39,624::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-340::DEBUG::2012-11-29 11:13:39,624::task::978::TaskManager.Task::(_decref) Task=`673cdfd6-7345-4688-827d-6b6aac4c3ae5`::ref 0 aborting False >Thread-341::DEBUG::2012-11-29 11:13:39,652::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-341::DEBUG::2012-11-29 11:13:39,652::task::588::TaskManager.Task::(_updateState) Task=`0369267b-836c-4cde-9c45-64649d53c842`::moving from state init -> state preparing >Thread-341::INFO::2012-11-29 11:13:39,653::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-341::INFO::2012-11-29 11:13:39,653::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-341::DEBUG::2012-11-29 11:13:39,653::task::1172::TaskManager.Task::(prepare) Task=`0369267b-836c-4cde-9c45-64649d53c842`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-341::DEBUG::2012-11-29 11:13:39,654::task::588::TaskManager.Task::(_updateState) Task=`0369267b-836c-4cde-9c45-64649d53c842`::moving from state preparing -> state finished >Thread-341::DEBUG::2012-11-29 11:13:39,654::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-341::DEBUG::2012-11-29 11:13:39,654::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-341::DEBUG::2012-11-29 11:13:39,655::task::978::TaskManager.Task::(_decref) Task=`0369267b-836c-4cde-9c45-64649d53c842`::ref 0 aborting False >Thread-342::DEBUG::2012-11-29 11:13:39,685::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-342::DEBUG::2012-11-29 11:13:39,685::task::588::TaskManager.Task::(_updateState) Task=`596d64a3-dd99-4f96-9e85-9fdafeb2f3c5`::moving from state init -> state preparing >Thread-342::INFO::2012-11-29 11:13:39,685::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217', spUUID=None, options=None) >Thread-342::DEBUG::2012-11-29 11:13:39,686::taskManager::161::TaskManager::(clearTask) Entry. taskID: 4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217 >Thread-342::DEBUG::2012-11-29 11:13:39,686::taskManager::166::TaskManager::(clearTask) Return. >Thread-342::INFO::2012-11-29 11:13:39,686::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-342::DEBUG::2012-11-29 11:13:39,687::task::1172::TaskManager.Task::(prepare) Task=`596d64a3-dd99-4f96-9e85-9fdafeb2f3c5`::finished: None >Thread-342::DEBUG::2012-11-29 11:13:39,687::task::588::TaskManager.Task::(_updateState) Task=`596d64a3-dd99-4f96-9e85-9fdafeb2f3c5`::moving from state preparing -> state finished >Thread-342::DEBUG::2012-11-29 11:13:39,687::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-342::DEBUG::2012-11-29 11:13:39,687::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-342::DEBUG::2012-11-29 11:13:39,688::task::978::TaskManager.Task::(_decref) Task=`596d64a3-dd99-4f96-9e85-9fdafeb2f3c5`::ref 0 aborting False >Thread-343::DEBUG::2012-11-29 11:13:39,732::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-343::DEBUG::2012-11-29 11:13:39,733::task::588::TaskManager.Task::(_updateState) Task=`d15d4e02-644f-4bdf-b345-6c933933e6f0`::moving from state init -> state preparing >Thread-343::INFO::2012-11-29 11:13:39,733::logUtils::37::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', hostID=1, scsiKey='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', options=None) >Thread-343::INFO::2012-11-29 11:13:39,733::hsm::970::Storage.HSM::(destroyStoragePool) spUUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9 >Thread-343::DEBUG::2012-11-29 11:13:39,734::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`fb529df3-38aa-478c-ad3d-96d1dc732006`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-343::DEBUG::2012-11-29 11:13:39,734::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-343::DEBUG::2012-11-29 11:13:39,735::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-343::DEBUG::2012-11-29 11:13:39,735::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`fb529df3-38aa-478c-ad3d-96d1dc732006`::Granted request >Thread-343::DEBUG::2012-11-29 11:13:39,735::task::817::TaskManager.Task::(resourceAcquired) Task=`d15d4e02-644f-4bdf-b345-6c933933e6f0`::_resourcesAcquired: Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9 (exclusive) >Thread-343::DEBUG::2012-11-29 11:13:39,736::task::978::TaskManager.Task::(_decref) Task=`d15d4e02-644f-4bdf-b345-6c933933e6f0`::ref 1 aborting False >Thread-343::DEBUG::2012-11-29 11:13:39,736::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`33a8822f-64ef-45eb-805a-75357cd527aa`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-343::DEBUG::2012-11-29 11:13:39,736::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'exclusive' >Thread-343::DEBUG::2012-11-29 11:13:39,737::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'exclusive' (1 active user) >Thread-343::DEBUG::2012-11-29 11:13:39,737::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`33a8822f-64ef-45eb-805a-75357cd527aa`::Granted request >Thread-343::DEBUG::2012-11-29 11:13:39,738::task::817::TaskManager.Task::(resourceAcquired) Task=`d15d4e02-644f-4bdf-b345-6c933933e6f0`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (exclusive) >Thread-343::DEBUG::2012-11-29 11:13:39,738::task::978::TaskManager.Task::(_decref) Task=`d15d4e02-644f-4bdf-b345-6c933933e6f0`::ref 1 aborting False >Thread-343::WARNING::2012-11-29 11:13:39,738::sp::961::Storage.StoragePool::(forcedDetachSD) Force detaching domain `f1008a0c-010a-45a0-b80c-f5e8514a76e7` >Thread-343::DEBUG::2012-11-29 11:13:39,739::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >Thread-343::DEBUG::2012-11-29 11:13:39,739::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >Thread-343::DEBUG::2012-11-29 11:13:39,739::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ebcbea7dfee306dac9ed79cc288990a807541023'] >Thread-343::DEBUG::2012-11-29 11:13:39,743::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >Thread-343::DEBUG::2012-11-29 11:13:39,744::sp::323::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-343::DEBUG::2012-11-29 11:13:39,744::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`671e191a-5372-4bfc-acb0-cfbb825893db`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-343::DEBUG::2012-11-29 11:13:39,744::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' for lock type 'exclusive' >Thread-343::DEBUG::2012-11-29 11:13:39,745::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free. Now locking as 'exclusive' (1 active user) >Thread-343::DEBUG::2012-11-29 11:13:39,745::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9`ReqID=`671e191a-5372-4bfc-acb0-cfbb825893db`::Granted request >Thread-343::DEBUG::2012-11-29 11:13:39,746::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-343::DEBUG::2012-11-29 11:13:39,746::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-343::DEBUG::2012-11-29 11:13:39,746::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-343::DEBUG::2012-11-29 11:13:39,746::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-343::DEBUG::2012-11-29 11:13:39,749::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,751::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,753::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,755::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,757::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,759::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,760::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,762::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,764::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,766::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,768::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,770::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,771::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,773::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,775::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,777::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,779::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,780::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,782::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,784::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,786::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,788::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,789::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,792::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,794::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,796::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,798::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,800::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,802::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,804::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,806::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,808::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,810::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,811::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,813::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,815::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,817::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,819::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,820::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,822::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,824::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,826::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,828::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,830::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >Thread-343::DEBUG::2012-11-29 11:13:39,830::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >Thread-343::DEBUG::2012-11-29 11:13:39,830::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >Thread-343::DEBUG::2012-11-29 11:13:39,831::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8d63bbfcda60fe1044b000e177a04569da9b9831'] >Thread-343::DEBUG::2012-11-29 11:13:39,834::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >Thread-343::INFO::2012-11-29 11:13:39,835::safelease::239::SANLock::(release) Releasing cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-343::DEBUG::2012-11-29 11:13:39,837::safelease::250::SANLock::(release) Cluster lock for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 successfully released >Thread-343::DEBUG::2012-11-29 11:13:39,837::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-343::DEBUG::2012-11-29 11:13:39,837::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-343::DEBUG::2012-11-29 11:13:39,840::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8d63bbfcda60fe1044b000e177a04569da9b9831'] >Thread-284::DEBUG::2012-11-29 11:13:39,840::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-284::INFO::2012-11-29 11:13:39,841::safelease::183::SANLock::(releaseHostId) Releasing host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 (id: 1) >Thread-284::DEBUG::2012-11-29 11:13:41,841::safelease::193::SANLock::(releaseHostId) Host id for domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 released successfully (id: 1) >Thread-343::DEBUG::2012-11-29 11:13:41,842::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `21ea8081-3262-478a-8e4a-8e46b0e2fbc9` stopped monitoring domain `f1008a0c-010a-45a0-b80c-f5e8514a76e7` >Thread-343::DEBUG::2012-11-29 11:13:41,842::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-343::DEBUG::2012-11-29 11:13:41,843::sp::978::Storage.StoragePool::(forcedDetachSD) Force detach for domain `f1008a0c-010a-45a0-b80c-f5e8514a76e7` is done >Thread-343::DEBUG::2012-11-29 11:13:41,846::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=21ea8081-3262-478a-8e4a-8e46b0e2fbc9', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Master', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8d63bbfcda60fe1044b000e177a04569da9b9831'] >Thread-343::DEBUG::2012-11-29 11:13:41,846::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction >Thread-343::DEBUG::2012-11-29 11:13:41,846::persistentDict::155::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-343::DEBUG::2012-11-29 11:13:41,847::persistentDict::155::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-343::DEBUG::2012-11-29 11:13:41,847::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes >Thread-343::DEBUG::2012-11-29 11:13:41,847::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=490d24d37a27e05468c6d4effb7b14f6365f019e'] >Thread-343::DEBUG::2012-11-29 11:13:41,851::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction >Thread-343::DEBUG::2012-11-29 11:13:41,851::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-343::DEBUG::2012-11-29 11:13:41,852::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-343::DEBUG::2012-11-29 11:13:41,854::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=490d24d37a27e05468c6d4effb7b14f6365f019e'] >Thread-343::DEBUG::2012-11-29 11:13:41,854::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-343::INFO::2012-11-29 11:13:41,855::sp::668::Storage.StoragePool::(disconnect) Disconnect from the storage pool 21ea8081-3262-478a-8e4a-8e46b0e2fbc9 >Thread-343::INFO::2012-11-29 11:13:41,855::logUtils::39::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True >Thread-343::DEBUG::2012-11-29 11:13:41,855::task::1172::TaskManager.Task::(prepare) Task=`d15d4e02-644f-4bdf-b345-6c933933e6f0`::finished: True >Thread-343::DEBUG::2012-11-29 11:13:41,856::task::588::TaskManager.Task::(_updateState) Task=`d15d4e02-644f-4bdf-b345-6c933933e6f0`::moving from state preparing -> state finished >Thread-343::DEBUG::2012-11-29 11:13:41,856::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9': < ResourceRef 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', isValid: 'True' obj: 'None'>, 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-343::DEBUG::2012-11-29 11:13:41,856::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-343::DEBUG::2012-11-29 11:13:41,857::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' >Thread-343::DEBUG::2012-11-29 11:13:41,857::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' (0 active users) >Thread-343::DEBUG::2012-11-29 11:13:41,857::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9' is free, finding out if anyone is waiting for it. >Thread-343::DEBUG::2012-11-29 11:13:41,858::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.21ea8081-3262-478a-8e4a-8e46b0e2fbc9', Clearing records. >Thread-343::DEBUG::2012-11-29 11:13:41,858::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-343::DEBUG::2012-11-29 11:13:41,858::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-343::DEBUG::2012-11-29 11:13:41,859::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-343::DEBUG::2012-11-29 11:13:41,859::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-343::DEBUG::2012-11-29 11:13:41,859::task::978::TaskManager.Task::(_decref) Task=`d15d4e02-644f-4bdf-b345-6c933933e6f0`::ref 0 aborting False >Thread-345::DEBUG::2012-11-29 11:13:41,915::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-345::DEBUG::2012-11-29 11:13:41,916::task::588::TaskManager.Task::(_updateState) Task=`ae2657a6-4dc2-4bde-8a90-bc9dd0d21a1a`::moving from state init -> state preparing >Thread-345::INFO::2012-11-29 11:13:41,916::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-345::DEBUG::2012-11-29 11:13:41,917::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391' (cwd None) >Thread-345::DEBUG::2012-11-29 11:13:41,940::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-345::DEBUG::2012-11-29 11:13:41,941::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-345::DEBUG::2012-11-29 11:13:41,941::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-345::DEBUG::2012-11-29 11:13:41,941::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-345::DEBUG::2012-11-29 11:13:41,942::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-345::DEBUG::2012-11-29 11:13:41,951::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-345::DEBUG::2012-11-29 11:13:41,952::misc::1054::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-345::DEBUG::2012-11-29 11:13:41,953::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-346::DEBUG::2012-11-29 11:13:42,159::task::588::TaskManager.Task::(_updateState) Task=`d6a786ab-7e05-435d-84ec-ec0be87f9515`::moving from state init -> state preparing >Thread-346::INFO::2012-11-29 11:13:42,159::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-346::INFO::2012-11-29 11:13:42,159::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-346::DEBUG::2012-11-29 11:13:42,160::task::1172::TaskManager.Task::(prepare) Task=`d6a786ab-7e05-435d-84ec-ec0be87f9515`::finished: {} >Thread-346::DEBUG::2012-11-29 11:13:42,160::task::588::TaskManager.Task::(_updateState) Task=`d6a786ab-7e05-435d-84ec-ec0be87f9515`::moving from state preparing -> state finished >Thread-346::DEBUG::2012-11-29 11:13:42,160::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-346::DEBUG::2012-11-29 11:13:42,161::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-346::DEBUG::2012-11-29 11:13:42,161::task::978::TaskManager.Task::(_decref) Task=`d6a786ab-7e05-435d-84ec-ec0be87f9515`::ref 0 aborting False >MainProcess|Thread-345::DEBUG::2012-11-29 11:13:42,957::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-345::DEBUG::2012-11-29 11:13:42,959::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-345::DEBUG::2012-11-29 11:13:43,963::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-345::DEBUG::2012-11-29 11:13:44,967::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-345::DEBUG::2012-11-29 11:13:44,969::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-345::DEBUG::2012-11-29 11:13:44,971::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-345::DEBUG::2012-11-29 11:13:46,974::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-345::DEBUG::2012-11-29 11:13:47,027::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-345::DEBUG::2012-11-29 11:13:47,028::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-345::DEBUG::2012-11-29 11:13:47,028::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-345::DEBUG::2012-11-29 11:13:47,029::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-345::DEBUG::2012-11-29 11:13:47,029::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-345::DEBUG::2012-11-29 11:13:47,029::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-345::DEBUG::2012-11-29 11:13:47,030::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-345::DEBUG::2012-11-29 11:13:47,030::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-345::INFO::2012-11-29 11:13:47,030::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-345::DEBUG::2012-11-29 11:13:47,031::task::1172::TaskManager.Task::(prepare) Task=`ae2657a6-4dc2-4bde-8a90-bc9dd0d21a1a`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-345::DEBUG::2012-11-29 11:13:47,031::task::588::TaskManager.Task::(_updateState) Task=`ae2657a6-4dc2-4bde-8a90-bc9dd0d21a1a`::moving from state preparing -> state finished >Thread-345::DEBUG::2012-11-29 11:13:47,031::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-345::DEBUG::2012-11-29 11:13:47,032::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-345::DEBUG::2012-11-29 11:13:47,032::task::978::TaskManager.Task::(_decref) Task=`ae2657a6-4dc2-4bde-8a90-bc9dd0d21a1a`::ref 0 aborting False >Thread-350::DEBUG::2012-11-29 11:13:47,084::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-350::DEBUG::2012-11-29 11:13:47,085::task::588::TaskManager.Task::(_updateState) Task=`3df4f2dd-0473-4f70-bbd0-d1094f8eb474`::moving from state init -> state preparing >Thread-350::INFO::2012-11-29 11:13:47,085::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', hostID=1, scsiKey='21ea8081-3262-478a-8e4a-8e46b0e2fbc9', remove=False, options=None) >Thread-350::WARNING::2012-11-29 11:13:47,086::hsm::937::Storage.HSM::(disconnectStoragePool) disconnect sp: 21ea8081-3262-478a-8e4a-8e46b0e2fbc9 failed. Known pools {} >Thread-350::INFO::2012-11-29 11:13:47,086::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-350::DEBUG::2012-11-29 11:13:47,086::task::1172::TaskManager.Task::(prepare) Task=`3df4f2dd-0473-4f70-bbd0-d1094f8eb474`::finished: None >Thread-350::DEBUG::2012-11-29 11:13:47,086::task::588::TaskManager.Task::(_updateState) Task=`3df4f2dd-0473-4f70-bbd0-d1094f8eb474`::moving from state preparing -> state finished >Thread-350::DEBUG::2012-11-29 11:13:47,087::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-350::DEBUG::2012-11-29 11:13:47,087::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-350::DEBUG::2012-11-29 11:13:47,087::task::978::TaskManager.Task::(_decref) Task=`3df4f2dd-0473-4f70-bbd0-d1094f8eb474`::ref 0 aborting False >Thread-352::DEBUG::2012-11-29 11:13:48,488::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-352::DEBUG::2012-11-29 11:13:48,488::task::588::TaskManager.Task::(_updateState) Task=`53d145d0-748f-4150-acff-8515796fec31`::moving from state init -> state preparing >Thread-352::INFO::2012-11-29 11:13:48,489::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-352::INFO::2012-11-29 11:13:48,489::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-352::DEBUG::2012-11-29 11:13:48,489::task::1172::TaskManager.Task::(prepare) Task=`53d145d0-748f-4150-acff-8515796fec31`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-352::DEBUG::2012-11-29 11:13:48,490::task::588::TaskManager.Task::(_updateState) Task=`53d145d0-748f-4150-acff-8515796fec31`::moving from state preparing -> state finished >Thread-352::DEBUG::2012-11-29 11:13:48,490::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-352::DEBUG::2012-11-29 11:13:48,490::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-352::DEBUG::2012-11-29 11:13:48,491::task::978::TaskManager.Task::(_decref) Task=`53d145d0-748f-4150-acff-8515796fec31`::ref 0 aborting False >Thread-353::DEBUG::2012-11-29 11:13:48,519::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-353::DEBUG::2012-11-29 11:13:48,519::task::588::TaskManager.Task::(_updateState) Task=`47b029e7-814d-4156-86b2-f517d4081d71`::moving from state init -> state preparing >Thread-353::INFO::2012-11-29 11:13:48,520::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-353::DEBUG::2012-11-29 11:13:48,522::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391' (cwd None) >Thread-353::INFO::2012-11-29 11:13:48,547::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-353::DEBUG::2012-11-29 11:13:48,547::task::1172::TaskManager.Task::(prepare) Task=`47b029e7-814d-4156-86b2-f517d4081d71`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-353::DEBUG::2012-11-29 11:13:48,547::task::588::TaskManager.Task::(_updateState) Task=`47b029e7-814d-4156-86b2-f517d4081d71`::moving from state preparing -> state finished >Thread-353::DEBUG::2012-11-29 11:13:48,548::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-353::DEBUG::2012-11-29 11:13:48,548::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-353::DEBUG::2012-11-29 11:13:48,548::task::978::TaskManager.Task::(_decref) Task=`47b029e7-814d-4156-86b2-f517d4081d71`::ref 0 aborting False >Thread-354::DEBUG::2012-11-29 11:13:48,584::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-354::DEBUG::2012-11-29 11:13:48,585::task::588::TaskManager.Task::(_updateState) Task=`5d6ac3f1-ff06-4c89-b7ba-c71f2a65cbcb`::moving from state init -> state preparing >Thread-354::INFO::2012-11-29 11:13:48,585::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='f1008a0c-010a-45a0-b80c-f5e8514a76e7', autoDetach=False, options=None) >Thread-354::DEBUG::2012-11-29 11:13:48,585::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-354::DEBUG::2012-11-29 11:13:48,586::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-354::DEBUG::2012-11-29 11:13:48,586::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-354::DEBUG::2012-11-29 11:13:48,596::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-354::DEBUG::2012-11-29 11:13:48,596::misc::1054::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:48,598::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:49,602::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:50,605::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:50,608::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:51,611::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-356::DEBUG::2012-11-29 11:13:52,363::task::588::TaskManager.Task::(_updateState) Task=`ff5e5dd2-2659-43f3-b725-f74a9438736a`::moving from state init -> state preparing >Thread-356::INFO::2012-11-29 11:13:52,363::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-356::INFO::2012-11-29 11:13:52,364::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-356::DEBUG::2012-11-29 11:13:52,364::task::1172::TaskManager.Task::(prepare) Task=`ff5e5dd2-2659-43f3-b725-f74a9438736a`::finished: {} >Thread-356::DEBUG::2012-11-29 11:13:52,364::task::588::TaskManager.Task::(_updateState) Task=`ff5e5dd2-2659-43f3-b725-f74a9438736a`::moving from state preparing -> state finished >Thread-356::DEBUG::2012-11-29 11:13:52,364::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-356::DEBUG::2012-11-29 11:13:52,365::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-356::DEBUG::2012-11-29 11:13:52,365::task::978::TaskManager.Task::(_decref) Task=`ff5e5dd2-2659-43f3-b725-f74a9438736a`::ref 0 aborting False >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:52,615::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:52,618::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-354::DEBUG::2012-11-29 11:13:54,621::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-354::DEBUG::2012-11-29 11:13:54,660::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2012-11-29 11:13:54,661::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`58fec4c0-e5ab-4031-9d30-40d98bfb57dc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '485' at 'registerResource' >Thread-354::DEBUG::2012-11-29 11:13:54,661::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' for lock type 'exclusive' >Thread-354::DEBUG::2012-11-29 11:13:54,661::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free. Now locking as 'exclusive' (1 active user) >Thread-354::DEBUG::2012-11-29 11:13:54,662::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7`ReqID=`58fec4c0-e5ab-4031-9d30-40d98bfb57dc`::Granted request >Thread-354::DEBUG::2012-11-29 11:13:54,662::task::817::TaskManager.Task::(resourceAcquired) Task=`5d6ac3f1-ff06-4c89-b7ba-c71f2a65cbcb`::_resourcesAcquired: Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7 (exclusive) >Thread-354::DEBUG::2012-11-29 11:13:54,663::task::978::TaskManager.Task::(_decref) Task=`5d6ac3f1-ff06-4c89-b7ba-c71f2a65cbcb`::ref 1 aborting False >Thread-354::DEBUG::2012-11-29 11:13:54,666::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=490d24d37a27e05468c6d4effb7b14f6365f019e'] >Thread-354::DEBUG::2012-11-29 11:13:54,666::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-354::DEBUG::2012-11-29 11:13:54,667::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-354::DEBUG::2012-11-29 11:13:54,667::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-354::DEBUG::2012-11-29 11:13:54,667::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-354::DEBUG::2012-11-29 11:13:54,668::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-354::DEBUG::2012-11-29 11:13:54,677::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-354::DEBUG::2012-11-29 11:13:54,678::misc::1054::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:54,679::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:55,682::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:55,685::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:56,688::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:57,692::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:58,695::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-354::DEBUG::2012-11-29 11:13:58,698::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-354::DEBUG::2012-11-29 11:14:00,701::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-354::DEBUG::2012-11-29 11:14:00,733::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-354::DEBUG::2012-11-29 11:14:00,734::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2012-11-29 11:14:00,734::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2012-11-29 11:14:00,735::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2012-11-29 11:14:00,735::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2012-11-29 11:14:00,735::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-354::DEBUG::2012-11-29 11:14:00,736::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-354::DEBUG::2012-11-29 11:14:00,736::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-354::DEBUG::2012-11-29 11:14:00,736::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-354::DEBUG::2012-11-29 11:14:00,737::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free f1008a0c-010a-45a0-b80c-f5e8514a76e7' (cwd None) >Thread-354::DEBUG::2012-11-29 11:14:00,867::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = ' Volume group "f1008a0c-010a-45a0-b80c-f5e8514a76e7" not found\n'; <rc> = 5 >Thread-354::WARNING::2012-11-29 11:14:00,868::lvm::356::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "f1008a0c-010a-45a0-b80c-f5e8514a76e7" not found'] >Thread-354::DEBUG::2012-11-29 11:14:00,869::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-354::DEBUG::2012-11-29 11:14:00,874::fileSD::124::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391/f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-354::DEBUG::2012-11-29 11:14:00,875::persistentDict::185::Storage.PersistentDict::(__init__) Created a persistant dict with FileMetadataRW backend >Thread-354::DEBUG::2012-11-29 11:14:00,877::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'ROLE=Regular', 'SDUUID=f1008a0c-010a-45a0-b80c-f5e8514a76e7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=490d24d37a27e05468c6d4effb7b14f6365f019e'] >Thread-354::DEBUG::2012-11-29 11:14:00,879::fileSD::447::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-354::WARNING::2012-11-29 11:14:00,879::sd::321::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f1008a0c-010a-45a0-b80c-f5e8514a76e7_imageNS already registered >Thread-354::WARNING::2012-11-29 11:14:00,879::sd::327::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f1008a0c-010a-45a0-b80c-f5e8514a76e7_volumeNS already registered >Thread-354::INFO::2012-11-29 11:14:00,880::fileSD::354::Storage.StorageDomain::(format) Formating domain f1008a0c-010a-45a0-b80c-f5e8514a76e7 >Thread-354::INFO::2012-11-29 11:14:00,893::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-354::DEBUG::2012-11-29 11:14:00,893::task::1172::TaskManager.Task::(prepare) Task=`5d6ac3f1-ff06-4c89-b7ba-c71f2a65cbcb`::finished: None >Thread-354::DEBUG::2012-11-29 11:14:00,893::task::588::TaskManager.Task::(_updateState) Task=`5d6ac3f1-ff06-4c89-b7ba-c71f2a65cbcb`::moving from state preparing -> state finished >Thread-354::DEBUG::2012-11-29 11:14:00,894::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7': < ResourceRef 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', isValid: 'True' obj: 'None'>} >Thread-354::DEBUG::2012-11-29 11:14:00,894::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-354::DEBUG::2012-11-29 11:14:00,894::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' >Thread-354::DEBUG::2012-11-29 11:14:00,895::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' (0 active users) >Thread-354::DEBUG::2012-11-29 11:14:00,895::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7' is free, finding out if anyone is waiting for it. >Thread-354::DEBUG::2012-11-29 11:14:00,895::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1008a0c-010a-45a0-b80c-f5e8514a76e7', Clearing records. >Thread-354::DEBUG::2012-11-29 11:14:00,896::task::978::TaskManager.Task::(_decref) Task=`5d6ac3f1-ff06-4c89-b7ba-c71f2a65cbcb`::ref 0 aborting False >Thread-372::DEBUG::2012-11-29 11:14:00,932::BindingXMLRPC::171::vds::(wrapper) [10.35.19.51] >Thread-372::DEBUG::2012-11-29 11:14:00,933::task::588::TaskManager.Task::(_updateState) Task=`21aa1d4c-3ac0-4564-9cea-b3f3ca3fa58c`::moving from state init -> state preparing >Thread-372::INFO::2012-11-29 11:14:00,933::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm07_nfs_2012112911259896391', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b', 'port': ''}], options=None) >Thread-372::DEBUG::2012-11-29 11:14:00,934::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm07__nfs__2012112911259896391' (cwd None) >Thread-372::DEBUG::2012-11-29 11:14:00,965::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-372::DEBUG::2012-11-29 11:14:00,966::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-372::DEBUG::2012-11-29 11:14:00,966::misc::1044::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-372::DEBUG::2012-11-29 11:14:00,967::misc::1046::SamplingMethod::(__call__) Got in to sampling method >Thread-372::DEBUG::2012-11-29 11:14:00,967::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-372::DEBUG::2012-11-29 11:14:00,976::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-372::DEBUG::2012-11-29 11:14:00,977::misc::1054::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-372::DEBUG::2012-11-29 11:14:00,979::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 11:14:01,982::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 11:14:01,985::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >Thread-373::DEBUG::2012-11-29 11:14:02,582::task::588::TaskManager.Task::(_updateState) Task=`56320312-25d3-4f72-94c9-cf28578629ca`::moving from state init -> state preparing >Thread-373::INFO::2012-11-29 11:14:02,582::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-373::INFO::2012-11-29 11:14:02,583::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-373::DEBUG::2012-11-29 11:14:02,583::task::1172::TaskManager.Task::(prepare) Task=`56320312-25d3-4f72-94c9-cf28578629ca`::finished: {} >Thread-373::DEBUG::2012-11-29 11:14:02,583::task::588::TaskManager.Task::(_updateState) Task=`56320312-25d3-4f72-94c9-cf28578629ca`::moving from state preparing -> state finished >Thread-373::DEBUG::2012-11-29 11:14:02,583::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-373::DEBUG::2012-11-29 11:14:02,584::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-373::DEBUG::2012-11-29 11:14:02,584::task::978::TaskManager.Task::(_decref) Task=`56320312-25d3-4f72-94c9-cf28578629ca`::ref 0 aborting False >MainProcess|Thread-372::DEBUG::2012-11-29 11:14:02,988::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 11:14:03,993::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 11:14:04,996::__init__::1164::Storage.Misc.excCmd::(_log) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 11:14:06,000::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-372::DEBUG::2012-11-29 11:14:08,003::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-372::DEBUG::2012-11-29 11:14:08,053::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 >Thread-372::DEBUG::2012-11-29 11:14:08,054::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2012-11-29 11:14:08,054::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2012-11-29 11:14:08,055::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2012-11-29 11:14:08,055::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2012-11-29 11:14:08,055::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2012-11-29 11:14:08,056::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2012-11-29 11:14:08,056::misc::1054::SamplingMethod::(__call__) Returning last result >Thread-372::INFO::2012-11-29 11:14:08,056::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-372::DEBUG::2012-11-29 11:14:08,057::task::1172::TaskManager.Task::(prepare) Task=`21aa1d4c-3ac0-4564-9cea-b3f3ca3fa58c`::finished: {'statuslist': [{'status': 0, 'id': '3a6cbe67-e215-474b-a78e-f86d00b6871b'}]} >Thread-372::DEBUG::2012-11-29 11:14:08,057::task::588::TaskManager.Task::(_updateState) Task=`21aa1d4c-3ac0-4564-9cea-b3f3ca3fa58c`::moving from state preparing -> state finished >Thread-372::DEBUG::2012-11-29 11:14:08,057::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-372::DEBUG::2012-11-29 11:14:08,057::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-372::DEBUG::2012-11-29 11:14:08,058::task::978::TaskManager.Task::(_decref) Task=`21aa1d4c-3ac0-4564-9cea-b3f3ca3fa58c`::ref 0 aborting False >Thread-378::DEBUG::2012-11-29 11:14:10,774::task::588::TaskManager.Task::(_updateState) Task=`2564df0b-250a-45cf-8839-05f0e97d0a25`::moving from state init -> state preparing >Thread-378::INFO::2012-11-29 11:14:10,774::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-378::INFO::2012-11-29 11:14:10,774::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-378::DEBUG::2012-11-29 11:14:10,775::task::1172::TaskManager.Task::(prepare) Task=`2564df0b-250a-45cf-8839-05f0e97d0a25`::finished: {} >Thread-378::DEBUG::2012-11-29 11:14:10,775::task::588::TaskManager.Task::(_updateState) Task=`2564df0b-250a-45cf-8839-05f0e97d0a25`::moving from state preparing -> state finished >Thread-378::DEBUG::2012-11-29 11:14:10,775::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-378::DEBUG::2012-11-29 11:14:10,775::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-378::DEBUG::2012-11-29 11:14:10,776::task::978::TaskManager.Task::(_decref) Task=`2564df0b-250a-45cf-8839-05f0e97d0a25`::ref 0 aborting False >MainThread::INFO::2012-11-29 12:09:09,540::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2012-11-29 12:09:09,554::task::588::TaskManager.Task::(_updateState) Task=`ba10e34c-ab48-43ce-8ce7-3f8e9a0eb78d`::moving from state init -> state preparing >MainThread::INFO::2012-11-29 12:09:09,554::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2012-11-29 12:09:09,555::storageServer::641::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2012-11-29 12:09:09,560::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,562::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,564::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,565::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,567::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,569::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,570::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,572::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,574::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,575::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,577::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,579::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,580::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,582::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,584::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,585::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,587::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,589::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,590::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,592::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,598::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,600::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,601::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,603::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,605::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,606::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,608::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,610::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,611::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,613::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,615::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,616::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,618::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,620::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,621::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,623::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,625::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,626::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,628::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,629::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,631::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,633::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,634::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,636::sp::363::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:09,735::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2012-11-29 12:09:09,736::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2012-11-29 12:09:09,736::task::1172::TaskManager.Task::(prepare) Task=`ba10e34c-ab48-43ce-8ce7-3f8e9a0eb78d`::finished: None >MainThread::DEBUG::2012-11-29 12:09:09,736::task::588::TaskManager.Task::(_updateState) Task=`ba10e34c-ab48-43ce-8ce7-3f8e9a0eb78d`::moving from state preparing -> state finished >MainThread::DEBUG::2012-11-29 12:09:09,737::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2012-11-29 12:09:09,737::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2012-11-29 12:09:09,737::task::978::TaskManager.Task::(_decref) Task=`ba10e34c-ab48-43ce-8ce7-3f8e9a0eb78d`::ref 0 aborting False >MainThread::INFO::2012-11-29 12:09:09,737::vdsm::75::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2012-11-29 12:09:09,738::vdsm::78::vds::(run) <_MainThread(MainThread, started 140028640069376)> >MainThread::INFO::2012-11-29 12:09:09,738::vdsm::78::vds::(run) <Thread(libvirtEventLoop, started daemon 140028552595200)> >MainThread::INFO::2012-11-29 12:09:09,738::vdsm::78::vds::(run) <WorkerThread(Thread-4, started daemon 140028281878272)> >MainThread::INFO::2012-11-29 12:09:09,739::vdsm::78::vds::(run) <WorkerThread(886d69ef-a3e1-4a67-abb7-793a57d9a887, started daemon 140028498114304)> >MainThread::INFO::2012-11-29 12:09:09,739::vdsm::78::vds::(run) <WorkerThread(Thread-2, started daemon 140028508604160)> >MainThread::INFO::2012-11-29 12:09:09,739::vdsm::78::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140027770156800)> >MainThread::INFO::2012-11-29 12:09:09,739::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2012-11-29 12:09:09,740::vdsm::78::vds::(run) <Listener(VM Channels Listener, started daemon 140027759666944)> >MainThread::INFO::2012-11-29 12:09:09,740::vdsm::78::vds::(run) <WorkerThread(dd6a2c2e-7524-4db5-a354-765ddbf17abb, started daemon 140028239918848)> >MainThread::INFO::2012-11-29 12:09:09,740::vdsm::78::vds::(run) <WorkerThread(Thread-7, started daemon 140028250408704)> >MainThread::INFO::2012-11-29 12:09:09,740::vdsm::78::vds::(run) <WorkerThread(1b869ebe-5376-42e5-a995-cb0cc15b9ada, started daemon 140028260898560)> >MainThread::INFO::2012-11-29 12:09:09,741::vdsm::78::vds::(run) <WorkerThread(Thread-5, started daemon 140028271388416)> >MainThread::INFO::2012-11-29 12:09:09,741::vdsm::78::vds::(run) <WorkerThread(4cdbf8f9-c9fd-4f49-ac8b-d6dfb4d9e217, started daemon 140027812116224)> >MainThread::INFO::2012-11-29 12:09:09,741::vdsm::78::vds::(run) <WorkerThread(5c255655-e3ca-428b-bb3e-ce4c27d2b6eb, started daemon 140028519094016)> >MainThread::INFO::2012-11-29 12:09:09,741::vdsm::78::vds::(run) <WorkerThread(Thread-9, started daemon 140028229428992)> >MainThread::INFO::2012-11-29 12:09:12,603::vdsm::88::vds::(run) I am the actual vdsm 4.10-1.0 cinteg02.ci.lab.tlv.redhat.com (2.6.32-279.el6.x86_64) >MainThread::DEBUG::2012-11-29 12:09:12,837::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2012-11-29 12:09:12,838::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2012-11-29 12:09:12,841::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2012-11-29 12:09:12,845::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,846::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,848::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,849::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,851::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,852::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,853::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,855::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,856::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,858::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,859::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,860::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,862::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,863::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,865::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,866::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,867::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,869::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,870::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,872::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,873::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,874::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,876::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,877::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,879::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,880::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,881::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,883::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,884::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,886::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,887::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,888::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,890::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,891::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,892::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,894::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,895::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,897::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,898::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,899::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,901::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,902::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,904::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:12,905::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:09:13,005::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2012-11-29 12:09:13,005::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py be5d1d50-8eab-4113-bb91-700e89118e91 14864 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2012-11-29 12:09:13,212::supervdsmServer::332::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2012-11-29 12:09:13,213::supervdsmServer::336::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2012-11-29 12:09:13,213::supervdsmServer::340::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2012-11-29 12:09:13,214::supervdsmServer::347::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2012-11-29 12:09:13,214::supervdsmServer::351::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2012-11-29 12:09:13,214::supervdsmServer::359::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2012-11-29 12:09:13,220::supervdsmServer::371::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2012-11-29 12:09:15,012::supervdsm::176::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2012-11-29 12:09:15,018::multipath::112::Storage.Multipath::(isEnabled) Downrev multipath.conf detected, upgrade required >MainThread::DEBUG::2012-11-29 12:09:15,019::misc::509::Storage.Misc::(rotateFiles) dir: /etc, prefixName: multipath.conf, versions: 5 >MainThread::DEBUG::2012-11-29 12:09:15,019::misc::530::Storage.Misc::(rotateFiles) versions found: [] >MainThread::DEBUG::2012-11-29 12:09:15,021::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/cp /tmp/tmpwksUyy /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2012-11-29 12:09:15,039::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 12:09:15,039::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2012-11-29 12:09:15,051::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 12:09:15,051::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service multipathd restart' (cwd None) >MainThread::DEBUG::2012-11-29 12:09:15,225::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 12:09:15,226::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2012-11-29 12:09:15,389::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 12:09:15,390::hsm::426::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2012-11-29 12:09:15,395::hsm::458::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2012-11-29 12:09:15,395::hsm::459::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2012-11-29 12:09:15,395::hsm::461::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2012-11-29 12:09:15,397::hsm::504::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2012-11-29 12:09:15,398::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >Thread-12::DEBUG::2012-11-29 12:09:15,399::lvm::334::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:15,401::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2012-11-29 12:09:15,422::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2012-11-29 12:09:15,423::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2012-11-29 12:09:15,500::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2012-11-29 12:09:15,500::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 99 >KsmMonitor::DEBUG::2012-11-29 12:09:15,500::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2012-11-29 12:09:15,501::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2012-11-29 12:09:15,506::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2012-11-29 12:09:15,517::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2012-11-29 12:09:15,518::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2012-11-29 12:09:15,532::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2012-11-29 12:09:15,532::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2012-11-29 12:09:15,558::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:09:15,564::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:09:15,565::lvm::359::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:15,565::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:15,565::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-12::DEBUG::2012-11-29 12:09:15,708::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:09:15,708::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:15,709::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-12::DEBUG::2012-11-29 12:09:15,850::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:09:15,850::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-12::DEBUG::2012-11-29 12:09:15,851::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 12:09:15,851::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-12::DEBUG::2012-11-29 12:09:15,851::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 12:09:15,851::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2012-11-29 12:09:15,862::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-12::DEBUG::2012-11-29 12:09:15,862::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-12::DEBUG::2012-11-29 12:09:15,864::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:09:16,868::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:09:17,872::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:09:17,877::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:09:17,879::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:09:17,881::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:09:17,883::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-12::DEBUG::2012-11-29 12:09:19,891::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-12::DEBUG::2012-11-29 12:09:19,966::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:09:19,967::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:19,971::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:19,971::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:19,972::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:19,972::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:19,972::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:09:19,972::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-12::WARNING::2012-11-29 12:09:19,973::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >MainThread::INFO::2012-11-29 12:19:02,125::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2012-11-29 12:19:02,130::task::568::TaskManager.Task::(_updateState) Task=`1459d948-dcf9-4b32-8af8-23cbd7ab1e74`::moving from state init -> state preparing >MainThread::INFO::2012-11-29 12:19:02,130::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2012-11-29 12:19:02,131::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2012-11-29 12:19:02,135::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,136::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,138::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,139::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,141::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,142::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,143::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,145::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,146::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,148::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,149::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,150::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,152::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,153::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,154::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,156::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,157::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,159::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,160::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,161::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,163::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,164::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,166::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,167::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,168::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,170::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,171::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,173::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,174::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,175::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,177::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,178::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,179::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,181::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,182::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,184::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,185::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,186::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,188::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,189::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,191::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,192::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,193::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,195::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:19:02,279::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2012-11-29 12:19:02,279::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2012-11-29 12:19:02,280::task::1151::TaskManager.Task::(prepare) Task=`1459d948-dcf9-4b32-8af8-23cbd7ab1e74`::finished: None >MainThread::DEBUG::2012-11-29 12:19:02,280::task::568::TaskManager.Task::(_updateState) Task=`1459d948-dcf9-4b32-8af8-23cbd7ab1e74`::moving from state preparing -> state finished >MainThread::DEBUG::2012-11-29 12:19:02,280::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2012-11-29 12:19:02,280::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2012-11-29 12:19:02,280::task::957::TaskManager.Task::(_decref) Task=`1459d948-dcf9-4b32-8af8-23cbd7ab1e74`::ref 0 aborting False >MainThread::INFO::2012-11-29 12:19:02,280::vdsm::94::vds::(run) VDSM main thread ended. Waiting for 12 other threads... >MainThread::INFO::2012-11-29 12:19:02,281::vdsm::98::vds::(run) <_MainThread(MainThread, started 139640796026624)> >MainThread::INFO::2012-11-29 12:19:02,281::vdsm::98::vds::(run) <Thread(libvirtEventLoop, started daemon 139640610772736)> >MainThread::INFO::2012-11-29 12:19:02,281::vdsm::98::vds::(run) <WorkerThread(Thread-7, started daemon 139640350684928)> >MainThread::INFO::2012-11-29 12:19:02,281::vdsm::98::vds::(run) <WorkerThread(Thread-10, started daemon 139639912392448)> >MainThread::INFO::2012-11-29 12:19:02,281::vdsm::98::vds::(run) <WorkerThread(Thread-6, started daemon 139640361174784)> >MainThread::INFO::2012-11-29 12:19:02,281::vdsm::98::vds::(run) <WorkerThread(Thread-2, started daemon 139640478914304)> >MainThread::INFO::2012-11-29 12:19:02,281::vdsm::98::vds::(run) <WorkerThread(Thread-8, started daemon 139640340195072)> >MainThread::INFO::2012-11-29 12:19:02,281::vdsm::98::vds::(run) <WorkerThread(Thread-1, started daemon 139640489404160)> >MainThread::INFO::2012-11-29 12:19:02,282::vdsm::98::vds::(run) <WorkerThread(Thread-3, started daemon 139640392644352)> >MainThread::INFO::2012-11-29 12:19:02,282::vdsm::98::vds::(run) <WorkerThread(Thread-9, started daemon 139639922882304)> >MainThread::INFO::2012-11-29 12:19:02,282::vdsm::98::vds::(run) <WorkerThread(Thread-5, started daemon 139640371664640)> >MainThread::INFO::2012-11-29 12:19:02,282::vdsm::98::vds::(run) <WorkerThread(Thread-4, started daemon 139640382154496)> >MainThread::INFO::2012-11-29 12:19:02,282::vdsm::98::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139639870433024)> >MainThread::INFO::2012-11-29 12:21:34,688::vdsm::88::vds::(run) I am the actual vdsm 4.10-1.0 cinteg02.ci.lab.tlv.redhat.com (2.6.32-279.el6.x86_64) >MainThread::DEBUG::2012-11-29 12:21:35,289::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2012-11-29 12:21:35,290::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2012-11-29 12:21:35,293::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2012-11-29 12:21:35,329::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,331::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,332::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,334::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,335::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,337::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,338::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,340::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,341::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,343::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,345::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,346::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,348::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,349::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,351::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,352::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,354::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,355::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,357::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,358::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,360::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,362::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,363::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,365::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,366::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,368::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,369::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,371::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,372::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,374::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,375::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,377::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,379::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,380::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,382::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,383::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,385::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,386::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,388::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,389::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,391::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,392::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,394::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,396::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 12:21:35,495::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2012-11-29 12:21:35,495::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py a449be50-37fe-4dca-a13a-ec5a24d04435 2706 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2012-11-29 12:21:36,093::supervdsmServer::332::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2012-11-29 12:21:36,093::supervdsmServer::336::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2012-11-29 12:21:36,094::supervdsmServer::340::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2012-11-29 12:21:36,094::supervdsmServer::347::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2012-11-29 12:21:36,094::supervdsmServer::351::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2012-11-29 12:21:36,094::supervdsmServer::359::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2012-11-29 12:21:36,096::supervdsmServer::371::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2012-11-29 12:21:37,536::supervdsm::176::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2012-11-29 12:21:37,546::multipath::112::Storage.Multipath::(isEnabled) Downrev multipath.conf detected, upgrade required >MainThread::DEBUG::2012-11-29 12:21:37,546::misc::509::Storage.Misc::(rotateFiles) dir: /etc, prefixName: multipath.conf, versions: 5 >MainThread::DEBUG::2012-11-29 12:21:37,547::misc::530::Storage.Misc::(rotateFiles) versions found: [] >MainThread::DEBUG::2012-11-29 12:21:37,549::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/cp /tmp/tmpCBX6d2 /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2012-11-29 12:21:37,659::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 12:21:37,659::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2012-11-29 12:21:37,678::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 12:21:37,679::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service multipathd restart' (cwd None) >MainThread::DEBUG::2012-11-29 12:21:37,858::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 12:21:37,858::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2012-11-29 12:21:38,025::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 12:21:38,026::hsm::426::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2012-11-29 12:21:38,028::hsm::458::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2012-11-29 12:21:38,029::hsm::459::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2012-11-29 12:21:38,029::hsm::461::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2012-11-29 12:21:38,066::hsm::504::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2012-11-29 12:21:38,067::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >Thread-12::DEBUG::2012-11-29 12:21:38,067::lvm::334::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:38,070::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2012-11-29 12:21:38,093::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2012-11-29 12:21:38,141::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >Thread-12::DEBUG::2012-11-29 12:21:38,242::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:21:38,243::lvm::359::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:38,243::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:38,244::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >MainThread::DEBUG::2012-11-29 12:21:38,309::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2012-11-29 12:21:38,310::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 99 >Thread-12::DEBUG::2012-11-29 12:21:38,400::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:21:38,459::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >KsmMonitor::DEBUG::2012-11-29 12:21:38,459::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2012-11-29 12:21:38,460::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >Thread-12::DEBUG::2012-11-29 12:21:38,461::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2012-11-29 12:21:38,465::vmChannels::127::vds::(run) Starting VM channels listener thread. >KsmMonitor::DEBUG::2012-11-29 12:21:38,556::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2012-11-29 12:21:38,557::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >MainThread::WARNING::2012-11-29 12:21:38,563::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2012-11-29 12:21:38,565::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2012-11-29 12:21:38,592::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:21:38,711::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:21:38,711::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-12::DEBUG::2012-11-29 12:21:38,712::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 12:21:38,712::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-12::DEBUG::2012-11-29 12:21:38,712::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 12:21:38,712::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2012-11-29 12:21:38,775::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-12::DEBUG::2012-11-29 12:21:38,776::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-12::DEBUG::2012-11-29 12:21:38,778::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:21:38,780::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:21:38,782::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:21:38,784::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:21:38,786::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:21:38,789::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 12:21:38,791::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-12::DEBUG::2012-11-29 12:21:40,794::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-12::DEBUG::2012-11-29 12:21:40,855::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 12:21:40,855::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:40,856::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:40,856::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:40,856::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:40,856::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:40,857::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 12:21:40,857::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-12::WARNING::2012-11-29 12:21:40,857::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >MainThread::INFO::2012-11-29 13:45:36,362::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2012-11-29 13:45:36,367::task::568::TaskManager.Task::(_updateState) Task=`1a9b35ff-99b3-4401-a92f-4877d0037e1a`::moving from state init -> state preparing >MainThread::INFO::2012-11-29 13:45:36,368::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2012-11-29 13:45:36,368::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2012-11-29 13:45:36,372::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,374::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,375::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,376::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,378::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,379::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,381::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,382::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,383::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,385::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,386::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,388::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,389::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,390::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,392::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,393::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,394::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,396::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,397::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,399::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,400::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,401::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,403::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,404::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,406::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,407::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,408::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,410::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,411::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,412::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,414::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,415::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,417::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,418::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,419::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,421::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,422::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,423::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,425::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,426::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,428::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,429::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,430::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,432::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:45:36,522::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2012-11-29 13:45:36,523::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2012-11-29 13:45:36,523::task::1151::TaskManager.Task::(prepare) Task=`1a9b35ff-99b3-4401-a92f-4877d0037e1a`::finished: None >MainThread::DEBUG::2012-11-29 13:45:36,523::task::568::TaskManager.Task::(_updateState) Task=`1a9b35ff-99b3-4401-a92f-4877d0037e1a`::moving from state preparing -> state finished >MainThread::DEBUG::2012-11-29 13:45:36,523::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2012-11-29 13:45:36,523::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2012-11-29 13:45:36,523::task::957::TaskManager.Task::(_decref) Task=`1a9b35ff-99b3-4401-a92f-4877d0037e1a`::ref 0 aborting False >MainThread::INFO::2012-11-29 13:45:36,524::vdsm::94::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2012-11-29 13:45:36,524::vdsm::98::vds::(run) <_MainThread(MainThread, started 139860946994944)> >MainThread::INFO::2012-11-29 13:45:36,524::vdsm::98::vds::(run) <Thread(libvirtEventLoop, started daemon 139860761208576)> >MainThread::INFO::2012-11-29 13:45:36,524::vdsm::98::vds::(run) <WorkerThread(Thread-3, started daemon 139860618721024)> >MainThread::INFO::2012-11-29 13:45:36,524::vdsm::98::vds::(run) <WorkerThread(Thread-2, started daemon 139860629210880)> >MainThread::INFO::2012-11-29 13:45:36,524::vdsm::98::vds::(run) <WorkerThread(Thread-9, started daemon 139860209813248)> >MainThread::INFO::2012-11-29 13:45:36,524::vdsm::98::vds::(run) <WorkerThread(Thread-10, started daemon 139860199323392)> >MainThread::INFO::2012-11-29 13:45:36,525::vdsm::98::vds::(run) <WorkerThread(Thread-1, started daemon 139860639700736)> >MainThread::INFO::2012-11-29 13:45:36,525::vdsm::98::vds::(run) <WorkerThread(Thread-7, started daemon 139860230792960)> >MainThread::INFO::2012-11-29 13:45:36,525::vdsm::98::vds::(run) <WorkerThread(Thread-6, started daemon 139860241282816)> >MainThread::INFO::2012-11-29 13:45:36,525::vdsm::98::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139859817649920)> >MainThread::INFO::2012-11-29 13:45:36,525::vdsm::98::vds::(run) <WorkerThread(Thread-8, started daemon 139860220303104)> >MainThread::INFO::2012-11-29 13:45:36,525::vdsm::98::vds::(run) <WorkerThread(Thread-5, started daemon 139860597741312)> >MainThread::INFO::2012-11-29 13:45:36,525::vdsm::98::vds::(run) <WorkerThread(Thread-4, started daemon 139860608231168)> >MainThread::INFO::2012-11-29 13:45:36,525::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2012-11-29 13:45:36,526::vdsm::98::vds::(run) <Listener(VM Channels Listener, started daemon 139859796670208)> >MainThread::INFO::2012-11-29 13:50:32,197::vdsm::88::vds::(run) I am the actual vdsm 4.10-1.0 cinteg02.ci.lab.tlv.redhat.com (2.6.32-279.el6.x86_64) >MainThread::DEBUG::2012-11-29 13:50:34,021::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2012-11-29 13:50:34,021::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2012-11-29 13:50:34,045::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2012-11-29 13:50:35,014::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,015::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,017::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,018::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,020::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,022::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,023::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,025::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,026::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,028::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,029::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,031::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,033::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,034::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,036::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,037::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,039::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,040::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,042::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,043::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,045::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,046::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,049::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,050::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,052::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,053::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,055::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,056::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,058::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,060::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,062::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,064::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,065::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,067::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,070::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,072::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,075::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,076::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,078::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,079::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,081::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,083::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,084::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,086::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 13:50:35,178::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2012-11-29 13:50:35,180::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 62521ce9-3800-440a-a4da-fa26219fc6de 2715 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2012-11-29 13:50:35,992::supervdsmServer::332::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2012-11-29 13:50:35,993::supervdsmServer::336::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2012-11-29 13:50:35,993::supervdsmServer::340::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2012-11-29 13:50:35,993::supervdsmServer::347::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2012-11-29 13:50:35,993::supervdsmServer::351::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2012-11-29 13:50:35,994::supervdsmServer::359::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2012-11-29 13:50:35,996::supervdsmServer::371::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2012-11-29 13:50:37,267::supervdsm::176::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2012-11-29 13:50:37,362::multipath::112::Storage.Multipath::(isEnabled) Downrev multipath.conf detected, upgrade required >MainThread::DEBUG::2012-11-29 13:50:37,362::misc::509::Storage.Misc::(rotateFiles) dir: /etc, prefixName: multipath.conf, versions: 5 >MainThread::DEBUG::2012-11-29 13:50:37,363::misc::530::Storage.Misc::(rotateFiles) versions found: [] >MainThread::DEBUG::2012-11-29 13:50:37,364::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/cp /tmp/tmpaKXDdO /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2012-11-29 13:50:37,385::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 13:50:37,386::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2012-11-29 13:50:37,401::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 13:50:37,402::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service multipathd restart' (cwd None) >MainThread::DEBUG::2012-11-29 13:50:37,576::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 13:50:37,577::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2012-11-29 13:50:37,749::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 13:50:37,749::hsm::426::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2012-11-29 13:50:37,751::hsm::458::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2012-11-29 13:50:37,752::hsm::459::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2012-11-29 13:50:37,752::hsm::461::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2012-11-29 13:50:37,781::hsm::504::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >Thread-12::DEBUG::2012-11-29 13:50:37,781::lvm::334::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >MainThread::INFO::2012-11-29 13:50:37,782::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >Thread-12::DEBUG::2012-11-29 13:50:37,788::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2012-11-29 13:50:37,804::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2012-11-29 13:50:37,896::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >Thread-12::DEBUG::2012-11-29 13:50:37,961::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 13:50:37,962::lvm::359::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:37,962::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:37,963::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >MainThread::DEBUG::2012-11-29 13:50:37,969::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2012-11-29 13:50:37,969::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 99 >KsmMonitor::DEBUG::2012-11-29 13:50:37,970::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2012-11-29 13:50:37,974::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2012-11-29 13:50:37,975::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2012-11-29 13:50:38,061::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2012-11-29 13:50:38,063::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2012-11-29 13:50:38,063::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2012-11-29 13:50:38,065::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2012-11-29 13:50:38,096::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 13:50:38,118::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 13:50:38,119::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:38,120::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-12::DEBUG::2012-11-29 13:50:38,273::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 13:50:38,273::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-12::DEBUG::2012-11-29 13:50:38,273::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 13:50:38,274::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-12::DEBUG::2012-11-29 13:50:38,274::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 13:50:38,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2012-11-29 13:50:38,306::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-12::DEBUG::2012-11-29 13:50:38,306::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-12::DEBUG::2012-11-29 13:50:38,309::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 13:50:38,312::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 13:50:38,314::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 13:50:38,317::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 13:50:38,320::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 13:50:38,322::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 13:50:38,324::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-12::DEBUG::2012-11-29 13:50:40,328::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-12::DEBUG::2012-11-29 13:50:40,408::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 13:50:40,409::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:40,409::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:40,409::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:40,409::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:40,410::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:40,410::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 13:50:40,410::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2012-11-29 13:52:44,624::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-14::DEBUG::2012-11-29 13:52:44,846::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.122', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-15::DEBUG::2012-11-29 13:52:44,979::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-15::DEBUG::2012-11-29 13:52:44,996::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.122', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-19::DEBUG::2012-11-29 13:52:51,306::task::568::TaskManager.Task::(_updateState) Task=`ada16e0e-ff3f-4982-8732-37488efe74a2`::moving from state init -> state preparing >Thread-19::INFO::2012-11-29 13:52:51,306::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::INFO::2012-11-29 13:52:51,306::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-19::DEBUG::2012-11-29 13:52:51,306::task::1151::TaskManager.Task::(prepare) Task=`ada16e0e-ff3f-4982-8732-37488efe74a2`::finished: {} >Thread-19::DEBUG::2012-11-29 13:52:51,307::task::568::TaskManager.Task::(_updateState) Task=`ada16e0e-ff3f-4982-8732-37488efe74a2`::moving from state preparing -> state finished >Thread-19::DEBUG::2012-11-29 13:52:51,307::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2012-11-29 13:52:51,307::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2012-11-29 13:52:51,307::task::957::TaskManager.Task::(_decref) Task=`ada16e0e-ff3f-4982-8732-37488efe74a2`::ref 0 aborting False >Thread-21::DEBUG::2012-11-29 13:52:53,271::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-21::DEBUG::2012-11-29 13:52:53,272::task::568::TaskManager.Task::(_updateState) Task=`4a23fa65-ba6a-4451-be0f-d9203005e9a5`::moving from state init -> state preparing >Thread-21::INFO::2012-11-29 13:52:53,272::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-21::INFO::2012-11-29 13:52:53,272::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-21::DEBUG::2012-11-29 13:52:53,272::task::1151::TaskManager.Task::(prepare) Task=`4a23fa65-ba6a-4451-be0f-d9203005e9a5`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-21::DEBUG::2012-11-29 13:52:53,272::task::568::TaskManager.Task::(_updateState) Task=`4a23fa65-ba6a-4451-be0f-d9203005e9a5`::moving from state preparing -> state finished >Thread-21::DEBUG::2012-11-29 13:52:53,273::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-21::DEBUG::2012-11-29 13:52:53,273::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-21::DEBUG::2012-11-29 13:52:53,273::task::957::TaskManager.Task::(_decref) Task=`4a23fa65-ba6a-4451-be0f-d9203005e9a5`::ref 0 aborting False >Thread-22::DEBUG::2012-11-29 13:52:53,322::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-22::DEBUG::2012-11-29 13:52:53,322::task::568::TaskManager.Task::(_updateState) Task=`36cb5993-d36c-4389-be27-c51dc9c64f58`::moving from state init -> state preparing >Thread-22::INFO::2012-11-29 13:52:53,322::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-22::DEBUG::2012-11-29 13:52:53,325::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323' (cwd None) >Thread-22::INFO::2012-11-29 13:52:53,544::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-22::DEBUG::2012-11-29 13:52:53,545::task::1151::TaskManager.Task::(prepare) Task=`36cb5993-d36c-4389-be27-c51dc9c64f58`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-22::DEBUG::2012-11-29 13:52:53,545::task::568::TaskManager.Task::(_updateState) Task=`36cb5993-d36c-4389-be27-c51dc9c64f58`::moving from state preparing -> state finished >Thread-22::DEBUG::2012-11-29 13:52:53,545::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2012-11-29 13:52:53,545::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2012-11-29 13:52:53,545::task::957::TaskManager.Task::(_decref) Task=`36cb5993-d36c-4389-be27-c51dc9c64f58`::ref 0 aborting False >Thread-24::DEBUG::2012-11-29 13:52:53,599::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-24::DEBUG::2012-11-29 13:52:53,600::task::568::TaskManager.Task::(_updateState) Task=`4c4fae90-4131-4266-8973-985ab769e0cb`::moving from state init -> state preparing >Thread-24::INFO::2012-11-29 13:52:53,600::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', options=None) >Thread-24::DEBUG::2012-11-29 13:52:53,600::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-24::DEBUG::2012-11-29 13:52:53,600::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-24::DEBUG::2012-11-29 13:52:53,601::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-24::DEBUG::2012-11-29 13:52:53,601::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-24::DEBUG::2012-11-29 13:52:53,601::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-24::DEBUG::2012-11-29 13:52:53,612::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-24::DEBUG::2012-11-29 13:52:53,612::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-24::DEBUG::2012-11-29 13:52:53,614::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-24::DEBUG::2012-11-29 13:52:53,616::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-24::DEBUG::2012-11-29 13:52:53,618::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-24::DEBUG::2012-11-29 13:52:53,620::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-24::DEBUG::2012-11-29 13:52:53,622::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-24::DEBUG::2012-11-29 13:52:53,624::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-24::DEBUG::2012-11-29 13:52:53,626::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-24::DEBUG::2012-11-29 13:52:55,629::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-24::DEBUG::2012-11-29 13:52:55,700::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2012-11-29 13:52:55,701::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2012-11-29 13:52:55,701::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2012-11-29 13:52:55,701::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2012-11-29 13:52:55,701::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2012-11-29 13:52:55,702::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2012-11-29 13:52:55,702::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2012-11-29 13:52:55,702::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-24::DEBUG::2012-11-29 13:52:55,702::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-24::DEBUG::2012-11-29 13:52:55,703::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-24::DEBUG::2012-11-29 13:52:55,879::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-24::DEBUG::2012-11-29 13:52:55,880::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-24::INFO::2012-11-29 13:52:56,003::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-24::DEBUG::2012-11-29 13:52:56,004::task::1151::TaskManager.Task::(prepare) Task=`4c4fae90-4131-4266-8973-985ab769e0cb`::finished: {'domlist': []} >Thread-24::DEBUG::2012-11-29 13:52:56,004::task::568::TaskManager.Task::(_updateState) Task=`4c4fae90-4131-4266-8973-985ab769e0cb`::moving from state preparing -> state finished >Thread-24::DEBUG::2012-11-29 13:52:56,004::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2012-11-29 13:52:56,004::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2012-11-29 13:52:56,004::task::957::TaskManager.Task::(_decref) Task=`4c4fae90-4131-4266-8973-985ab769e0cb`::ref 0 aborting False >Thread-31::DEBUG::2012-11-29 13:52:56,127::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-31::DEBUG::2012-11-29 13:52:56,127::task::568::TaskManager.Task::(_updateState) Task=`b5b88b76-6643-49fd-91a1-b93c6e7076a2`::moving from state init -> state preparing >Thread-31::INFO::2012-11-29 13:52:56,128::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', domainName='DataDomainRest', typeSpecificArg='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', domClass=1, domVersion='3', options=None) >Thread-31::DEBUG::2012-11-29 13:52:56,128::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-31::DEBUG::2012-11-29 13:52:56,129::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 81105f27-0d06-428d-bedf-308ae0109fb5' (cwd None) >Thread-31::DEBUG::2012-11-29 13:52:56,282::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found\n'; <rc> = 5 >Thread-31::WARNING::2012-11-29 13:52:56,282::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found'] >Thread-31::DEBUG::2012-11-29 13:52:56,284::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-31::INFO::2012-11-29 13:52:56,295::nfsSD::68::Storage.StorageDomain::(create) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 domainName=DataDomainRest remotePath=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323 domClass=1 >Thread-31::DEBUG::2012-11-29 13:52:56,447::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-31::DEBUG::2012-11-29 13:52:56,448::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-31::WARNING::2012-11-29 13:52:56,448::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-31::DEBUG::2012-11-29 13:52:56,448::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-31::DEBUG::2012-11-29 13:52:56,449::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-31::DEBUG::2012-11-29 13:52:56,449::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c2eb0ad3bb059e2714a4584306e6b0f9d5cd13b1'] >Thread-31::DEBUG::2012-11-29 13:52:56,452::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-31::DEBUG::2012-11-29 13:52:56,453::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-31::DEBUG::2012-11-29 13:52:56,453::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-31::DEBUG::2012-11-29 13:52:56,456::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c2eb0ad3bb059e2714a4584306e6b0f9d5cd13b1'] >Thread-31::DEBUG::2012-11-29 13:52:56,458::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-31::DEBUG::2012-11-29 13:52:56,459::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS' >Thread-31::DEBUG::2012-11-29 13:52:56,459::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS' >Thread-31::DEBUG::2012-11-29 13:52:56,496::sd::396::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-31::INFO::2012-11-29 13:52:56,497::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-31::DEBUG::2012-11-29 13:52:56,497::task::1151::TaskManager.Task::(prepare) Task=`b5b88b76-6643-49fd-91a1-b93c6e7076a2`::finished: None >Thread-31::DEBUG::2012-11-29 13:52:56,497::task::568::TaskManager.Task::(_updateState) Task=`b5b88b76-6643-49fd-91a1-b93c6e7076a2`::moving from state preparing -> state finished >Thread-31::DEBUG::2012-11-29 13:52:56,497::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-31::DEBUG::2012-11-29 13:52:56,497::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-31::DEBUG::2012-11-29 13:52:56,498::task::957::TaskManager.Task::(_decref) Task=`b5b88b76-6643-49fd-91a1-b93c6e7076a2`::ref 0 aborting False >Thread-37::DEBUG::2012-11-29 13:52:56,529::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-37::DEBUG::2012-11-29 13:52:56,529::task::568::TaskManager.Task::(_updateState) Task=`62743bc3-c72c-446c-a475-2adaabe0bf9b`::moving from state init -> state preparing >Thread-37::INFO::2012-11-29 13:52:56,530::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', options=None) >Thread-37::DEBUG::2012-11-29 13:52:56,530::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`dd1d21b8-89dd-440a-8ab3-a13f77211f62`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-37::DEBUG::2012-11-29 13:52:56,530::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-37::DEBUG::2012-11-29 13:52:56,531::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-37::DEBUG::2012-11-29 13:52:56,531::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`dd1d21b8-89dd-440a-8ab3-a13f77211f62`::Granted request >Thread-37::DEBUG::2012-11-29 13:52:56,531::task::794::TaskManager.Task::(resourceAcquired) Task=`62743bc3-c72c-446c-a475-2adaabe0bf9b`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-37::DEBUG::2012-11-29 13:52:56,531::task::957::TaskManager.Task::(_decref) Task=`62743bc3-c72c-446c-a475-2adaabe0bf9b`::ref 1 aborting False >Thread-37::INFO::2012-11-29 13:52:56,532::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '859927740416', 'disktotal': '859927740416', 'mdafree': 0}} >Thread-37::DEBUG::2012-11-29 13:52:56,533::task::1151::TaskManager.Task::(prepare) Task=`62743bc3-c72c-446c-a475-2adaabe0bf9b`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '859927740416', 'disktotal': '859927740416', 'mdafree': 0}} >Thread-37::DEBUG::2012-11-29 13:52:56,533::task::568::TaskManager.Task::(_updateState) Task=`62743bc3-c72c-446c-a475-2adaabe0bf9b`::moving from state preparing -> state finished >Thread-37::DEBUG::2012-11-29 13:52:56,533::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >Thread-37::DEBUG::2012-11-29 13:52:56,533::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2012-11-29 13:52:56,533::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-37::DEBUG::2012-11-29 13:52:56,534::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-37::DEBUG::2012-11-29 13:52:56,534::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-37::DEBUG::2012-11-29 13:52:56,534::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-37::DEBUG::2012-11-29 13:52:56,534::task::957::TaskManager.Task::(_decref) Task=`62743bc3-c72c-446c-a475-2adaabe0bf9b`::ref 0 aborting False >Thread-39::DEBUG::2012-11-29 13:52:58,032::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-39::DEBUG::2012-11-29 13:52:58,032::task::568::TaskManager.Task::(_updateState) Task=`a76d5c05-c5c5-44e3-88b7-2fa0bef55741`::moving from state init -> state preparing >Thread-39::INFO::2012-11-29 13:52:58,032::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-39::INFO::2012-11-29 13:52:58,032::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-39::DEBUG::2012-11-29 13:52:58,033::task::1151::TaskManager.Task::(prepare) Task=`a76d5c05-c5c5-44e3-88b7-2fa0bef55741`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-39::DEBUG::2012-11-29 13:52:58,033::task::568::TaskManager.Task::(_updateState) Task=`a76d5c05-c5c5-44e3-88b7-2fa0bef55741`::moving from state preparing -> state finished >Thread-39::DEBUG::2012-11-29 13:52:58,033::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-39::DEBUG::2012-11-29 13:52:58,033::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-39::DEBUG::2012-11-29 13:52:58,033::task::957::TaskManager.Task::(_decref) Task=`a76d5c05-c5c5-44e3-88b7-2fa0bef55741`::ref 0 aborting False >Thread-40::DEBUG::2012-11-29 13:52:58,067::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-40::DEBUG::2012-11-29 13:52:58,067::task::568::TaskManager.Task::(_updateState) Task=`5c1f5d61-d585-45c5-b5ca-029f91ca07dc`::moving from state init -> state preparing >Thread-40::INFO::2012-11-29 13:52:58,068::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-40::INFO::2012-11-29 13:52:58,070::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-40::DEBUG::2012-11-29 13:52:58,070::task::1151::TaskManager.Task::(prepare) Task=`5c1f5d61-d585-45c5-b5ca-029f91ca07dc`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-40::DEBUG::2012-11-29 13:52:58,070::task::568::TaskManager.Task::(_updateState) Task=`5c1f5d61-d585-45c5-b5ca-029f91ca07dc`::moving from state preparing -> state finished >Thread-40::DEBUG::2012-11-29 13:52:58,070::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-40::DEBUG::2012-11-29 13:52:58,071::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2012-11-29 13:52:58,071::task::957::TaskManager.Task::(_decref) Task=`5c1f5d61-d585-45c5-b5ca-029f91ca07dc`::ref 0 aborting False >Thread-41::DEBUG::2012-11-29 13:52:58,110::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-41::DEBUG::2012-11-29 13:52:58,110::task::568::TaskManager.Task::(_updateState) Task=`1618529c-abad-4452-abd8-8aa396ce954d`::moving from state init -> state preparing >Thread-41::INFO::2012-11-29 13:52:58,111::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', poolName='DefaultRest', masterDom='81105f27-0d06-428d-bedf-308ae0109fb5', domList=['81105f27-0d06-428d-bedf-308ae0109fb5'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-41::INFO::2012-11-29 13:52:58,111::fileSD::302::Storage.StorageDomain::(validate) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-41::DEBUG::2012-11-29 13:52:58,113::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c2eb0ad3bb059e2714a4584306e6b0f9d5cd13b1'] >Thread-41::DEBUG::2012-11-29 13:52:58,114::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`71dea715-37d8-4f73-af3d-9476369b4f7f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-41::DEBUG::2012-11-29 13:52:58,114::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-41::DEBUG::2012-11-29 13:52:58,114::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-41::DEBUG::2012-11-29 13:52:58,115::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`71dea715-37d8-4f73-af3d-9476369b4f7f`::Granted request >Thread-41::DEBUG::2012-11-29 13:52:58,115::task::794::TaskManager.Task::(resourceAcquired) Task=`1618529c-abad-4452-abd8-8aa396ce954d`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (exclusive) >Thread-41::DEBUG::2012-11-29 13:52:58,115::task::957::TaskManager.Task::(_decref) Task=`1618529c-abad-4452-abd8-8aa396ce954d`::ref 1 aborting False >Thread-41::DEBUG::2012-11-29 13:52:58,116::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`0d26ea2a-8607-46b9-83f9-041213bb790c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-41::DEBUG::2012-11-29 13:52:58,116::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'exclusive' >Thread-41::DEBUG::2012-11-29 13:52:58,116::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'exclusive' (1 active user) >Thread-41::DEBUG::2012-11-29 13:52:58,116::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`0d26ea2a-8607-46b9-83f9-041213bb790c`::Granted request >Thread-41::DEBUG::2012-11-29 13:52:58,117::task::794::TaskManager.Task::(resourceAcquired) Task=`1618529c-abad-4452-abd8-8aa396ce954d`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (exclusive) >Thread-41::DEBUG::2012-11-29 13:52:58,117::task::957::TaskManager.Task::(_decref) Task=`1618529c-abad-4452-abd8-8aa396ce954d`::ref 1 aborting False >Thread-41::INFO::2012-11-29 13:52:58,117::sp::544::Storage.StoragePool::(create) spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b poolName=DefaultRest master_sd=81105f27-0d06-428d-bedf-308ae0109fb5 domList=['81105f27-0d06-428d-bedf-308ae0109fb5'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-41::INFO::2012-11-29 13:52:58,117::fileSD::302::Storage.StorageDomain::(validate) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-41::DEBUG::2012-11-29 13:52:58,120::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c2eb0ad3bb059e2714a4584306e6b0f9d5cd13b1'] >Thread-41::DEBUG::2012-11-29 13:52:58,123::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c2eb0ad3bb059e2714a4584306e6b0f9d5cd13b1'] >Thread-41::DEBUG::2012-11-29 13:52:58,123::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-41::DEBUG::2012-11-29 13:52:58,123::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-41::DEBUG::2012-11-29 13:52:58,124::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=acd59839dec5b1e8be38e4a2c5e71f3d52613198'] >Thread-41::DEBUG::2012-11-29 13:52:58,127::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-41::INFO::2012-11-29 13:52:58,127::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 250) >Thread-43::DEBUG::2012-11-29 13:53:01,639::task::568::TaskManager.Task::(_updateState) Task=`827e0092-f25e-43aa-863b-43fa40442af0`::moving from state init -> state preparing >Thread-43::INFO::2012-11-29 13:53:01,639::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-43::INFO::2012-11-29 13:53:01,639::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-43::DEBUG::2012-11-29 13:53:01,639::task::1151::TaskManager.Task::(prepare) Task=`827e0092-f25e-43aa-863b-43fa40442af0`::finished: {} >Thread-43::DEBUG::2012-11-29 13:53:01,640::task::568::TaskManager.Task::(_updateState) Task=`827e0092-f25e-43aa-863b-43fa40442af0`::moving from state preparing -> state finished >Thread-43::DEBUG::2012-11-29 13:53:01,640::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-43::DEBUG::2012-11-29 13:53:01,640::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2012-11-29 13:53:01,640::task::957::TaskManager.Task::(_decref) Task=`827e0092-f25e-43aa-863b-43fa40442af0`::ref 0 aborting False >Thread-49::DEBUG::2012-11-29 13:53:11,855::task::568::TaskManager.Task::(_updateState) Task=`d74f653f-8670-4deb-8739-826ce08de36b`::moving from state init -> state preparing >Thread-49::INFO::2012-11-29 13:53:11,855::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-49::INFO::2012-11-29 13:53:11,855::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-49::DEBUG::2012-11-29 13:53:11,855::task::1151::TaskManager.Task::(prepare) Task=`d74f653f-8670-4deb-8739-826ce08de36b`::finished: {} >Thread-49::DEBUG::2012-11-29 13:53:11,855::task::568::TaskManager.Task::(_updateState) Task=`d74f653f-8670-4deb-8739-826ce08de36b`::moving from state preparing -> state finished >Thread-49::DEBUG::2012-11-29 13:53:11,855::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49::DEBUG::2012-11-29 13:53:11,855::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49::DEBUG::2012-11-29 13:53:11,856::task::957::TaskManager.Task::(_decref) Task=`d74f653f-8670-4deb-8739-826ce08de36b`::ref 0 aborting False >Thread-41::DEBUG::2012-11-29 13:53:19,132::safelease::178::SANLock::(acquireHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully acquired (id: 250) >Thread-41::INFO::2012-11-29 13:53:19,132::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 250) >Thread-41::DEBUG::2012-11-29 13:53:19,171::safelease::235::SANLock::(acquire) Cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully acquired (id: 250) >Thread-41::INFO::2012-11-29 13:53:19,171::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID 1354c897-ef7d-4edf-aa4c-c1e1464d0e2b on sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-41::DEBUG::2012-11-29 13:53:19,171::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-41::DEBUG::2012-11-29 13:53:19,171::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-41::DEBUG::2012-11-29 13:53:19,174::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=acd59839dec5b1e8be38e4a2c5e71f3d52613198'] >Thread-41::DEBUG::2012-11-29 13:53:19,175::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-41::DEBUG::2012-11-29 13:53:19,175::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-41::DEBUG::2012-11-29 13:53:19,175::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-41::DEBUG::2012-11-29 13:53:19,175::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-41::DEBUG::2012-11-29 13:53:19,175::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=962ac5a59051d8e733fc302f35acc98af2be71bb'] >Thread-41::DEBUG::2012-11-29 13:53:19,180::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-41::DEBUG::2012-11-29 13:53:19,181::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 81105f27-0d06-428d-bedf-308ae0109fb5 verified, version 1 >Thread-41::DEBUG::2012-11-29 13:53:19,181::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-41::DEBUG::2012-11-29 13:53:19,181::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-41::DEBUG::2012-11-29 13:53:19,184::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=962ac5a59051d8e733fc302f35acc98af2be71bb'] >Thread-54::DEBUG::2012-11-29 13:53:19,185::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-41::DEBUG::2012-11-29 13:53:19,185::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `1354c897-ef7d-4edf-aa4c-c1e1464d0e2b` started monitoring domain `81105f27-0d06-428d-bedf-308ae0109fb5` >Thread-41::DEBUG::2012-11-29 13:53:19,185::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-41::WARNING::2012-11-29 13:53:19,186::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b already exists >Thread-41::DEBUG::2012-11-29 13:53:19,187::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-41::DEBUG::2012-11-29 13:53:19,189::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-41::DEBUG::2012-11-29 13:53:19,331::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-41::DEBUG::2012-11-29 13:53:19,332::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-41::INFO::2012-11-29 13:53:19,342::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 to /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-41::INFO::2012-11-29 13:53:19,343::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 to /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd >Thread-41::INFO::2012-11-29 13:53:19,343::safelease::239::SANLock::(release) Releasing cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-41::DEBUG::2012-11-29 13:53:19,345::safelease::250::SANLock::(release) Cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully released >Thread-41::INFO::2012-11-29 13:53:19,345::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 250) >Thread-41::DEBUG::2012-11-29 13:53:21,346::safelease::193::SANLock::(releaseHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 released successfully (id: 250) >Thread-54::DEBUG::2012-11-29 13:53:21,346::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-54::INFO::2012-11-29 13:53:21,346::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 250) >Thread-54::DEBUG::2012-11-29 13:53:21,347::safelease::193::SANLock::(releaseHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 released successfully (id: 250) >Thread-41::INFO::2012-11-29 13:53:21,347::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-41::DEBUG::2012-11-29 13:53:21,347::task::1151::TaskManager.Task::(prepare) Task=`1618529c-abad-4452-abd8-8aa396ce954d`::finished: True >Thread-41::DEBUG::2012-11-29 13:53:21,347::task::568::TaskManager.Task::(_updateState) Task=`1618529c-abad-4452-abd8-8aa396ce954d`::moving from state preparing -> state finished >Thread-41::DEBUG::2012-11-29 13:53:21,348::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>, 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-41::DEBUG::2012-11-29 13:53:21,348::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-41::DEBUG::2012-11-29 13:53:21,348::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-41::DEBUG::2012-11-29 13:53:21,348::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-41::DEBUG::2012-11-29 13:53:21,348::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-41::DEBUG::2012-11-29 13:53:21,349::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-41::DEBUG::2012-11-29 13:53:21,349::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-41::DEBUG::2012-11-29 13:53:21,349::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-41::DEBUG::2012-11-29 13:53:21,349::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-41::DEBUG::2012-11-29 13:53:21,349::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-41::DEBUG::2012-11-29 13:53:21,350::task::957::TaskManager.Task::(_decref) Task=`1618529c-abad-4452-abd8-8aa396ce954d`::ref 0 aborting False >Thread-61::DEBUG::2012-11-29 13:53:21,441::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-61::DEBUG::2012-11-29 13:53:21,442::task::568::TaskManager.Task::(_updateState) Task=`76b13493-a6c9-464c-9b43-b1f54be0fc79`::moving from state init -> state preparing >Thread-61::INFO::2012-11-29 13:53:21,442::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-61::INFO::2012-11-29 13:53:21,442::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-61::DEBUG::2012-11-29 13:53:21,442::task::1151::TaskManager.Task::(prepare) Task=`76b13493-a6c9-464c-9b43-b1f54be0fc79`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-61::DEBUG::2012-11-29 13:53:21,442::task::568::TaskManager.Task::(_updateState) Task=`76b13493-a6c9-464c-9b43-b1f54be0fc79`::moving from state preparing -> state finished >Thread-61::DEBUG::2012-11-29 13:53:21,442::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-61::DEBUG::2012-11-29 13:53:21,443::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-61::DEBUG::2012-11-29 13:53:21,443::task::957::TaskManager.Task::(_decref) Task=`76b13493-a6c9-464c-9b43-b1f54be0fc79`::ref 0 aborting False >Thread-62::DEBUG::2012-11-29 13:53:21,476::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-62::DEBUG::2012-11-29 13:53:21,476::task::568::TaskManager.Task::(_updateState) Task=`8e7ffaad-5560-46a1-b928-dae73b533bab`::moving from state init -> state preparing >Thread-62::INFO::2012-11-29 13:53:21,477::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-62::INFO::2012-11-29 13:53:21,478::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-62::DEBUG::2012-11-29 13:53:21,479::task::1151::TaskManager.Task::(prepare) Task=`8e7ffaad-5560-46a1-b928-dae73b533bab`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-62::DEBUG::2012-11-29 13:53:21,479::task::568::TaskManager.Task::(_updateState) Task=`8e7ffaad-5560-46a1-b928-dae73b533bab`::moving from state preparing -> state finished >Thread-62::DEBUG::2012-11-29 13:53:21,479::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-62::DEBUG::2012-11-29 13:53:21,479::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::DEBUG::2012-11-29 13:53:21,479::task::957::TaskManager.Task::(_decref) Task=`8e7ffaad-5560-46a1-b928-dae73b533bab`::ref 0 aborting False >Thread-63::DEBUG::2012-11-29 13:53:21,563::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-63::DEBUG::2012-11-29 13:53:21,564::task::568::TaskManager.Task::(_updateState) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::moving from state init -> state preparing >Thread-63::INFO::2012-11-29 13:53:21,564::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-63::ERROR::2012-11-29 13:53:21,564::task::833::TaskManager.Task::(_setError) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 597, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 310, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('1354c897-ef7d-4edf-aa4c-c1e1464d0e2b',) >Thread-63::DEBUG::2012-11-29 13:53:21,591::task::852::TaskManager.Task::(_run) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::Task._run: 212725a5-8aec-4228-aa0d-d1c4dba81b77 ('1354c897-ef7d-4edf-aa4c-c1e1464d0e2b',) {} failed - stopping task >Thread-63::DEBUG::2012-11-29 13:53:21,591::task::1177::TaskManager.Task::(stop) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::stopping in state preparing (force False) >Thread-63::DEBUG::2012-11-29 13:53:21,591::task::957::TaskManager.Task::(_decref) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::ref 1 aborting True >Thread-63::INFO::2012-11-29 13:53:21,591::task::1134::TaskManager.Task::(prepare) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-63::DEBUG::2012-11-29 13:53:21,591::task::1139::TaskManager.Task::(prepare) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::Prepare: aborted: Unknown pool id, pool not connected >Thread-63::DEBUG::2012-11-29 13:53:21,591::task::957::TaskManager.Task::(_decref) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::ref 0 aborting True >Thread-63::DEBUG::2012-11-29 13:53:21,592::task::892::TaskManager.Task::(_doAbort) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::Task._doAbort: force False >Thread-63::DEBUG::2012-11-29 13:53:21,592::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-63::DEBUG::2012-11-29 13:53:21,592::task::568::TaskManager.Task::(_updateState) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::moving from state preparing -> state aborting >Thread-63::DEBUG::2012-11-29 13:53:21,592::task::523::TaskManager.Task::(__state_aborting) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::_aborting: recover policy none >Thread-63::DEBUG::2012-11-29 13:53:21,592::task::568::TaskManager.Task::(_updateState) Task=`212725a5-8aec-4228-aa0d-d1c4dba81b77`::moving from state aborting -> state failed >Thread-63::DEBUG::2012-11-29 13:53:21,592::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-63::DEBUG::2012-11-29 13:53:21,593::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-63::ERROR::2012-11-29 13:53:21,593::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('1354c897-ef7d-4edf-aa4c-c1e1464d0e2b',)", 'code': 309}} >Thread-64::DEBUG::2012-11-29 13:53:21,685::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-64::DEBUG::2012-11-29 13:53:21,685::task::568::TaskManager.Task::(_updateState) Task=`5c0c1e56-da3f-4276-ae9c-f82656661bc3`::moving from state init -> state preparing >Thread-64::INFO::2012-11-29 13:53:21,685::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', hostID=1, scsiKey='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', msdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', masterVersion=1, options=None) >Thread-64::DEBUG::2012-11-29 13:53:21,686::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`56c0dbd1-8c47-46ae-b22c-def9d8ba4430`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-64::DEBUG::2012-11-29 13:53:21,686::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-64::DEBUG::2012-11-29 13:53:21,686::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-64::DEBUG::2012-11-29 13:53:21,686::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`56c0dbd1-8c47-46ae-b22c-def9d8ba4430`::Granted request >Thread-64::INFO::2012-11-29 13:53:21,687::sp::628::Storage.StoragePool::(connect) Connect host #1 to the storage pool 1354c897-ef7d-4edf-aa4c-c1e1464d0e2b with master domain: 81105f27-0d06-428d-bedf-308ae0109fb5 (ver = 1) >Thread-64::DEBUG::2012-11-29 13:53:21,687::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:21,687::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:21,687::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:21,688::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:21,688::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:21,688::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:21,688::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-64::DEBUG::2012-11-29 13:53:21,688::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-64::DEBUG::2012-11-29 13:53:21,689::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-64::DEBUG::2012-11-29 13:53:21,689::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-64::DEBUG::2012-11-29 13:53:21,689::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-64::DEBUG::2012-11-29 13:53:21,700::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-64::DEBUG::2012-11-29 13:53:21,700::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-64::DEBUG::2012-11-29 13:53:21,703::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-64::DEBUG::2012-11-29 13:53:21,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-64::DEBUG::2012-11-29 13:53:21,707::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-64::DEBUG::2012-11-29 13:53:21,709::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-64::DEBUG::2012-11-29 13:53:21,711::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-64::DEBUG::2012-11-29 13:53:21,713::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-64::DEBUG::2012-11-29 13:53:21,715::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-65::DEBUG::2012-11-29 13:53:22,074::task::568::TaskManager.Task::(_updateState) Task=`454b198b-e8a3-4876-8060-071c57ea62e7`::moving from state init -> state preparing >Thread-65::INFO::2012-11-29 13:53:22,074::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-65::INFO::2012-11-29 13:53:22,074::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-65::DEBUG::2012-11-29 13:53:22,075::task::1151::TaskManager.Task::(prepare) Task=`454b198b-e8a3-4876-8060-071c57ea62e7`::finished: {} >Thread-65::DEBUG::2012-11-29 13:53:22,075::task::568::TaskManager.Task::(_updateState) Task=`454b198b-e8a3-4876-8060-071c57ea62e7`::moving from state preparing -> state finished >Thread-65::DEBUG::2012-11-29 13:53:22,075::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-65::DEBUG::2012-11-29 13:53:22,075::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-65::DEBUG::2012-11-29 13:53:22,075::task::957::TaskManager.Task::(_decref) Task=`454b198b-e8a3-4876-8060-071c57ea62e7`::ref 0 aborting False >Thread-64::DEBUG::2012-11-29 13:53:23,718::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-64::DEBUG::2012-11-29 13:53:23,779::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2012-11-29 13:53:23,780::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,780::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,780::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,780::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,781::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,781::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,781::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-64::DEBUG::2012-11-29 13:53:23,781::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,782::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 81105f27-0d06-428d-bedf-308ae0109fb5' (cwd None) >Thread-64::DEBUG::2012-11-29 13:53:23,934::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found\n'; <rc> = 5 >Thread-64::WARNING::2012-11-29 13:53:23,935::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found'] >Thread-64::DEBUG::2012-11-29 13:53:23,935::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,951::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-64::DEBUG::2012-11-29 13:53:23,951::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-64::DEBUG::2012-11-29 13:53:23,955::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=962ac5a59051d8e733fc302f35acc98af2be71bb'] >Thread-64::DEBUG::2012-11-29 13:53:23,956::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-64::WARNING::2012-11-29 13:53:23,956::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_imageNS already registered >Thread-64::WARNING::2012-11-29 13:53:23,956::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS already registered >Thread-64::DEBUG::2012-11-29 13:53:23,957::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 81105f27-0d06-428d-bedf-308ae0109fb5 verified, version 1 >Thread-64::DEBUG::2012-11-29 13:53:23,957::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-64::DEBUG::2012-11-29 13:53:23,957::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-64::DEBUG::2012-11-29 13:53:23,960::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=962ac5a59051d8e733fc302f35acc98af2be71bb'] >Thread-64::DEBUG::2012-11-29 13:53:23,961::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `1354c897-ef7d-4edf-aa4c-c1e1464d0e2b` started monitoring domain `81105f27-0d06-428d-bedf-308ae0109fb5` >Thread-72::DEBUG::2012-11-29 13:53:23,961::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-64::DEBUG::2012-11-29 13:53:23,961::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-64::WARNING::2012-11-29 13:53:23,962::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b already exists >Thread-64::DEBUG::2012-11-29 13:53:23,965::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2012-11-29 13:53:23,970::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-72::INFO::2012-11-29 13:53:23,981::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 1) >Thread-72::DEBUG::2012-11-29 13:53:23,982::safelease::178::SANLock::(acquireHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully acquired (id: 1) >Thread-64::DEBUG::2012-11-29 13:53:24,113::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-64::DEBUG::2012-11-29 13:53:24,113::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-64::INFO::2012-11-29 13:53:24,124::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 to /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-64::INFO::2012-11-29 13:53:24,124::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 to /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd >Thread-64::DEBUG::2012-11-29 13:53:24,125::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-64::DEBUG::2012-11-29 13:53:24,125::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-64::DEBUG::2012-11-29 13:53:24,125::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-64::DEBUG::2012-11-29 13:53:24,125::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-64::INFO::2012-11-29 13:53:24,126::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-64::DEBUG::2012-11-29 13:53:24,126::task::1151::TaskManager.Task::(prepare) Task=`5c0c1e56-da3f-4276-ae9c-f82656661bc3`::finished: True >Thread-64::DEBUG::2012-11-29 13:53:24,126::task::568::TaskManager.Task::(_updateState) Task=`5c0c1e56-da3f-4276-ae9c-f82656661bc3`::moving from state preparing -> state finished >Thread-64::DEBUG::2012-11-29 13:53:24,126::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2012-11-29 13:53:24,126::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2012-11-29 13:53:24,127::task::957::TaskManager.Task::(_decref) Task=`5c0c1e56-da3f-4276-ae9c-f82656661bc3`::ref 0 aborting False >Thread-78::DEBUG::2012-11-29 13:53:24,154::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-78::DEBUG::2012-11-29 13:53:24,155::task::568::TaskManager.Task::(_updateState) Task=`ac2d5180-5b06-4006-a616-32b9cddc5656`::moving from state init -> state preparing >Thread-78::INFO::2012-11-29 13:53:24,156::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-78::INFO::2012-11-29 13:53:24,156::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-78::DEBUG::2012-11-29 13:53:24,156::task::1151::TaskManager.Task::(prepare) Task=`ac2d5180-5b06-4006-a616-32b9cddc5656`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-78::DEBUG::2012-11-29 13:53:24,156::task::568::TaskManager.Task::(_updateState) Task=`ac2d5180-5b06-4006-a616-32b9cddc5656`::moving from state preparing -> state finished >Thread-78::DEBUG::2012-11-29 13:53:24,156::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-78::DEBUG::2012-11-29 13:53:24,157::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2012-11-29 13:53:24,157::task::957::TaskManager.Task::(_decref) Task=`ac2d5180-5b06-4006-a616-32b9cddc5656`::ref 0 aborting False >Thread-80::DEBUG::2012-11-29 13:53:24,205::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-80::DEBUG::2012-11-29 13:53:24,206::task::568::TaskManager.Task::(_updateState) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::moving from state init -> state preparing >Thread-80::INFO::2012-11-29 13:53:24,206::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-80::DEBUG::2012-11-29 13:53:24,206::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`09d56982-34ec-4366-a4ea-80f75e6128a2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-80::DEBUG::2012-11-29 13:53:24,206::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-80::DEBUG::2012-11-29 13:53:24,207::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-80::DEBUG::2012-11-29 13:53:24,207::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`09d56982-34ec-4366-a4ea-80f75e6128a2`::Granted request >Thread-80::DEBUG::2012-11-29 13:53:24,207::task::794::TaskManager.Task::(resourceAcquired) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (exclusive) >Thread-80::DEBUG::2012-11-29 13:53:24,207::task::957::TaskManager.Task::(_decref) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::ref 1 aborting False >Thread-80::INFO::2012-11-29 13:53:24,208::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-80::DEBUG::2012-11-29 13:53:24,208::task::1146::TaskManager.Task::(prepare) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::Prepare: 1 jobs exist, move to acquiring >Thread-80::DEBUG::2012-11-29 13:53:24,208::task::568::TaskManager.Task::(_updateState) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::moving from state preparing -> state acquiring >Thread-80::DEBUG::2012-11-29 13:53:24,208::task::568::TaskManager.Task::(_updateState) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::moving from state acquiring -> state queued >Thread-80::DEBUG::2012-11-29 13:53:24,208::taskManager::50::TaskManager::(_queueTask) queuing task: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-80::DEBUG::2012-11-29 13:53:24,209::taskManager::56::TaskManager::(_queueTask) task queued: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-4::DEBUG::2012-11-29 13:53:24,209::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-80::DEBUG::2012-11-29 13:53:24,210::task::1148::TaskManager.Task::(prepare) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::returning >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,210::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 running: <bound method Task.commit of <storage.task.Task instance at 0x1a275a8>> with: None >Thread-80::DEBUG::2012-11-29 13:53:24,211::task::957::TaskManager.Task::(_decref) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::ref 0 aborting False >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,211::task::1159::TaskManager.Task::(commit) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::committing task: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,212::task::568::TaskManager.Task::(_updateState) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::moving from state queued -> state running >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,213::task::872::TaskManager.Task::(_runJobs) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f417c25a290>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,214::task::304::TaskManager.Task::(run) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f417c25a290>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,214::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,214::misc::1027::SamplingMethod::(__call__) Got in to sampling method >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,217::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=962ac5a59051d8e733fc302f35acc98af2be71bb'] >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,217::misc::1035::SamplingMethod::(__call__) Returning last result >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:24,220::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=962ac5a59051d8e733fc302f35acc98af2be71bb'] >58301b23-cd93-4c49-8cd7-6de38f5b36a4::INFO::2012-11-29 13:53:24,220::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 1) >Thread-81::DEBUG::2012-11-29 13:53:25,249::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-81::DEBUG::2012-11-29 13:53:25,250::task::568::TaskManager.Task::(_updateState) Task=`a81f2673-0249-40d3-a7f6-8ef10bab3063`::moving from state init -> state preparing >Thread-81::INFO::2012-11-29 13:53:25,250::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-81::DEBUG::2012-11-29 13:53:25,250::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-81::DEBUG::2012-11-29 13:53:25,250::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-81::INFO::2012-11-29 13:53:25,250::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-81::DEBUG::2012-11-29 13:53:25,251::task::1151::TaskManager.Task::(prepare) Task=`a81f2673-0249-40d3-a7f6-8ef10bab3063`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-81::DEBUG::2012-11-29 13:53:25,251::task::568::TaskManager.Task::(_updateState) Task=`a81f2673-0249-40d3-a7f6-8ef10bab3063`::moving from state preparing -> state finished >Thread-81::DEBUG::2012-11-29 13:53:25,251::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2012-11-29 13:53:25,251::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2012-11-29 13:53:25,251::task::957::TaskManager.Task::(_decref) Task=`a81f2673-0249-40d3-a7f6-8ef10bab3063`::ref 0 aborting False >Thread-83::DEBUG::2012-11-29 13:53:26,282::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-83::DEBUG::2012-11-29 13:53:26,283::task::568::TaskManager.Task::(_updateState) Task=`912c37a0-6014-4188-89e1-65c74db51005`::moving from state init -> state preparing >Thread-83::INFO::2012-11-29 13:53:26,283::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-83::DEBUG::2012-11-29 13:53:26,283::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-83::DEBUG::2012-11-29 13:53:26,283::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-83::INFO::2012-11-29 13:53:26,283::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-83::DEBUG::2012-11-29 13:53:26,283::task::1151::TaskManager.Task::(prepare) Task=`912c37a0-6014-4188-89e1-65c74db51005`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-83::DEBUG::2012-11-29 13:53:26,284::task::568::TaskManager.Task::(_updateState) Task=`912c37a0-6014-4188-89e1-65c74db51005`::moving from state preparing -> state finished >Thread-83::DEBUG::2012-11-29 13:53:26,284::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-83::DEBUG::2012-11-29 13:53:26,284::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-83::DEBUG::2012-11-29 13:53:26,284::task::957::TaskManager.Task::(_decref) Task=`912c37a0-6014-4188-89e1-65c74db51005`::ref 0 aborting False >Thread-84::DEBUG::2012-11-29 13:53:27,313::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-84::DEBUG::2012-11-29 13:53:27,314::task::568::TaskManager.Task::(_updateState) Task=`16826ad5-d39d-47e9-bf07-97332f0e8b06`::moving from state init -> state preparing >Thread-84::INFO::2012-11-29 13:53:27,314::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-84::DEBUG::2012-11-29 13:53:27,314::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-84::DEBUG::2012-11-29 13:53:27,314::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-84::INFO::2012-11-29 13:53:27,314::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-84::DEBUG::2012-11-29 13:53:27,315::task::1151::TaskManager.Task::(prepare) Task=`16826ad5-d39d-47e9-bf07-97332f0e8b06`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-84::DEBUG::2012-11-29 13:53:27,315::task::568::TaskManager.Task::(_updateState) Task=`16826ad5-d39d-47e9-bf07-97332f0e8b06`::moving from state preparing -> state finished >Thread-84::DEBUG::2012-11-29 13:53:27,315::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84::DEBUG::2012-11-29 13:53:27,315::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84::DEBUG::2012-11-29 13:53:27,315::task::957::TaskManager.Task::(_decref) Task=`16826ad5-d39d-47e9-bf07-97332f0e8b06`::ref 0 aborting False >Thread-86::DEBUG::2012-11-29 13:53:28,344::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-86::DEBUG::2012-11-29 13:53:28,344::task::568::TaskManager.Task::(_updateState) Task=`3adc24f9-2fdf-45e7-a4f1-5a0cbd513fed`::moving from state init -> state preparing >Thread-86::INFO::2012-11-29 13:53:28,344::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-86::DEBUG::2012-11-29 13:53:28,345::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-86::DEBUG::2012-11-29 13:53:28,345::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-86::INFO::2012-11-29 13:53:28,345::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-86::DEBUG::2012-11-29 13:53:28,345::task::1151::TaskManager.Task::(prepare) Task=`3adc24f9-2fdf-45e7-a4f1-5a0cbd513fed`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-86::DEBUG::2012-11-29 13:53:28,345::task::568::TaskManager.Task::(_updateState) Task=`3adc24f9-2fdf-45e7-a4f1-5a0cbd513fed`::moving from state preparing -> state finished >Thread-86::DEBUG::2012-11-29 13:53:28,345::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-86::DEBUG::2012-11-29 13:53:28,346::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-86::DEBUG::2012-11-29 13:53:28,346::task::957::TaskManager.Task::(_decref) Task=`3adc24f9-2fdf-45e7-a4f1-5a0cbd513fed`::ref 0 aborting False >Thread-87::DEBUG::2012-11-29 13:53:29,375::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-87::DEBUG::2012-11-29 13:53:29,375::task::568::TaskManager.Task::(_updateState) Task=`1585b346-4c7d-4ecb-a481-7aa568786c2e`::moving from state init -> state preparing >Thread-87::INFO::2012-11-29 13:53:29,376::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-87::DEBUG::2012-11-29 13:53:29,376::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-87::DEBUG::2012-11-29 13:53:29,376::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-87::INFO::2012-11-29 13:53:29,376::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-87::DEBUG::2012-11-29 13:53:29,376::task::1151::TaskManager.Task::(prepare) Task=`1585b346-4c7d-4ecb-a481-7aa568786c2e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-87::DEBUG::2012-11-29 13:53:29,377::task::568::TaskManager.Task::(_updateState) Task=`1585b346-4c7d-4ecb-a481-7aa568786c2e`::moving from state preparing -> state finished >Thread-87::DEBUG::2012-11-29 13:53:29,377::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-87::DEBUG::2012-11-29 13:53:29,377::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-87::DEBUG::2012-11-29 13:53:29,377::task::957::TaskManager.Task::(_decref) Task=`1585b346-4c7d-4ecb-a481-7aa568786c2e`::ref 0 aborting False >Thread-89::DEBUG::2012-11-29 13:53:30,405::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-89::DEBUG::2012-11-29 13:53:30,405::task::568::TaskManager.Task::(_updateState) Task=`c5a34187-2f53-4998-b7fc-cebe2e79d448`::moving from state init -> state preparing >Thread-89::INFO::2012-11-29 13:53:30,405::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-89::DEBUG::2012-11-29 13:53:30,405::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-89::DEBUG::2012-11-29 13:53:30,406::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-89::INFO::2012-11-29 13:53:30,406::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-89::DEBUG::2012-11-29 13:53:30,406::task::1151::TaskManager.Task::(prepare) Task=`c5a34187-2f53-4998-b7fc-cebe2e79d448`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-89::DEBUG::2012-11-29 13:53:30,406::task::568::TaskManager.Task::(_updateState) Task=`c5a34187-2f53-4998-b7fc-cebe2e79d448`::moving from state preparing -> state finished >Thread-89::DEBUG::2012-11-29 13:53:30,406::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-89::DEBUG::2012-11-29 13:53:30,406::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-89::DEBUG::2012-11-29 13:53:30,407::task::957::TaskManager.Task::(_decref) Task=`c5a34187-2f53-4998-b7fc-cebe2e79d448`::ref 0 aborting False >Thread-90::DEBUG::2012-11-29 13:53:31,435::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-90::DEBUG::2012-11-29 13:53:31,435::task::568::TaskManager.Task::(_updateState) Task=`ccd0c026-be07-47f8-89e1-41f75cbee4a5`::moving from state init -> state preparing >Thread-90::INFO::2012-11-29 13:53:31,435::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-90::DEBUG::2012-11-29 13:53:31,435::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-90::DEBUG::2012-11-29 13:53:31,435::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-90::INFO::2012-11-29 13:53:31,436::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-90::DEBUG::2012-11-29 13:53:31,436::task::1151::TaskManager.Task::(prepare) Task=`ccd0c026-be07-47f8-89e1-41f75cbee4a5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-90::DEBUG::2012-11-29 13:53:31,436::task::568::TaskManager.Task::(_updateState) Task=`ccd0c026-be07-47f8-89e1-41f75cbee4a5`::moving from state preparing -> state finished >Thread-90::DEBUG::2012-11-29 13:53:31,436::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-90::DEBUG::2012-11-29 13:53:31,436::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-90::DEBUG::2012-11-29 13:53:31,436::task::957::TaskManager.Task::(_decref) Task=`ccd0c026-be07-47f8-89e1-41f75cbee4a5`::ref 0 aborting False >Thread-91::DEBUG::2012-11-29 13:53:32,298::task::568::TaskManager.Task::(_updateState) Task=`c6df1579-0f01-4a06-b899-a29dcd93e809`::moving from state init -> state preparing >Thread-91::INFO::2012-11-29 13:53:32,298::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-91::INFO::2012-11-29 13:53:32,298::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00210809707642', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-91::DEBUG::2012-11-29 13:53:32,298::task::1151::TaskManager.Task::(prepare) Task=`c6df1579-0f01-4a06-b899-a29dcd93e809`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00210809707642', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-91::DEBUG::2012-11-29 13:53:32,299::task::568::TaskManager.Task::(_updateState) Task=`c6df1579-0f01-4a06-b899-a29dcd93e809`::moving from state preparing -> state finished >Thread-91::DEBUG::2012-11-29 13:53:32,299::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-91::DEBUG::2012-11-29 13:53:32,299::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2012-11-29 13:53:32,299::task::957::TaskManager.Task::(_decref) Task=`c6df1579-0f01-4a06-b899-a29dcd93e809`::ref 0 aborting False >Thread-93::DEBUG::2012-11-29 13:53:32,464::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-93::DEBUG::2012-11-29 13:53:32,465::task::568::TaskManager.Task::(_updateState) Task=`20adc585-1ce8-4445-978d-4c480b3940fc`::moving from state init -> state preparing >Thread-93::INFO::2012-11-29 13:53:32,465::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-93::DEBUG::2012-11-29 13:53:32,465::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-93::DEBUG::2012-11-29 13:53:32,465::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-93::INFO::2012-11-29 13:53:32,465::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-93::DEBUG::2012-11-29 13:53:32,465::task::1151::TaskManager.Task::(prepare) Task=`20adc585-1ce8-4445-978d-4c480b3940fc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-93::DEBUG::2012-11-29 13:53:32,466::task::568::TaskManager.Task::(_updateState) Task=`20adc585-1ce8-4445-978d-4c480b3940fc`::moving from state preparing -> state finished >Thread-93::DEBUG::2012-11-29 13:53:32,466::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-93::DEBUG::2012-11-29 13:53:32,466::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-93::DEBUG::2012-11-29 13:53:32,466::task::957::TaskManager.Task::(_decref) Task=`20adc585-1ce8-4445-978d-4c480b3940fc`::ref 0 aborting False >Thread-94::DEBUG::2012-11-29 13:53:33,495::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-94::DEBUG::2012-11-29 13:53:33,495::task::568::TaskManager.Task::(_updateState) Task=`6807b7b0-e2d8-42e5-a9e5-7f6cd38cbfa7`::moving from state init -> state preparing >Thread-94::INFO::2012-11-29 13:53:33,495::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-94::DEBUG::2012-11-29 13:53:33,495::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-94::DEBUG::2012-11-29 13:53:33,496::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-94::INFO::2012-11-29 13:53:33,496::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-94::DEBUG::2012-11-29 13:53:33,496::task::1151::TaskManager.Task::(prepare) Task=`6807b7b0-e2d8-42e5-a9e5-7f6cd38cbfa7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-94::DEBUG::2012-11-29 13:53:33,496::task::568::TaskManager.Task::(_updateState) Task=`6807b7b0-e2d8-42e5-a9e5-7f6cd38cbfa7`::moving from state preparing -> state finished >Thread-94::DEBUG::2012-11-29 13:53:33,496::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-94::DEBUG::2012-11-29 13:53:33,496::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-94::DEBUG::2012-11-29 13:53:33,496::task::957::TaskManager.Task::(_decref) Task=`6807b7b0-e2d8-42e5-a9e5-7f6cd38cbfa7`::ref 0 aborting False >Thread-96::DEBUG::2012-11-29 13:53:34,527::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-96::DEBUG::2012-11-29 13:53:34,527::task::568::TaskManager.Task::(_updateState) Task=`1c26fabc-1ed1-4aa3-a9c5-620e952043ab`::moving from state init -> state preparing >Thread-96::INFO::2012-11-29 13:53:34,527::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-96::DEBUG::2012-11-29 13:53:34,527::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-96::DEBUG::2012-11-29 13:53:34,527::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-96::INFO::2012-11-29 13:53:34,528::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-96::DEBUG::2012-11-29 13:53:34,528::task::1151::TaskManager.Task::(prepare) Task=`1c26fabc-1ed1-4aa3-a9c5-620e952043ab`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-96::DEBUG::2012-11-29 13:53:34,528::task::568::TaskManager.Task::(_updateState) Task=`1c26fabc-1ed1-4aa3-a9c5-620e952043ab`::moving from state preparing -> state finished >Thread-96::DEBUG::2012-11-29 13:53:34,528::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-96::DEBUG::2012-11-29 13:53:34,528::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-96::DEBUG::2012-11-29 13:53:34,528::task::957::TaskManager.Task::(_decref) Task=`1c26fabc-1ed1-4aa3-a9c5-620e952043ab`::ref 0 aborting False >Thread-97::DEBUG::2012-11-29 13:53:35,557::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-97::DEBUG::2012-11-29 13:53:35,558::task::568::TaskManager.Task::(_updateState) Task=`ca83fbbc-6e2e-48fa-b1e2-fac39e13b405`::moving from state init -> state preparing >Thread-97::INFO::2012-11-29 13:53:35,558::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-97::DEBUG::2012-11-29 13:53:35,558::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-97::DEBUG::2012-11-29 13:53:35,558::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-97::INFO::2012-11-29 13:53:35,558::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-97::DEBUG::2012-11-29 13:53:35,558::task::1151::TaskManager.Task::(prepare) Task=`ca83fbbc-6e2e-48fa-b1e2-fac39e13b405`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-97::DEBUG::2012-11-29 13:53:35,559::task::568::TaskManager.Task::(_updateState) Task=`ca83fbbc-6e2e-48fa-b1e2-fac39e13b405`::moving from state preparing -> state finished >Thread-97::DEBUG::2012-11-29 13:53:35,559::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2012-11-29 13:53:35,559::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2012-11-29 13:53:35,559::task::957::TaskManager.Task::(_decref) Task=`ca83fbbc-6e2e-48fa-b1e2-fac39e13b405`::ref 0 aborting False >Thread-99::DEBUG::2012-11-29 13:53:36,587::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-99::DEBUG::2012-11-29 13:53:36,587::task::568::TaskManager.Task::(_updateState) Task=`821c3dc2-5f16-4474-92b2-442b48081007`::moving from state init -> state preparing >Thread-99::INFO::2012-11-29 13:53:36,588::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-99::DEBUG::2012-11-29 13:53:36,588::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-99::DEBUG::2012-11-29 13:53:36,588::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-99::INFO::2012-11-29 13:53:36,588::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-99::DEBUG::2012-11-29 13:53:36,588::task::1151::TaskManager.Task::(prepare) Task=`821c3dc2-5f16-4474-92b2-442b48081007`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-99::DEBUG::2012-11-29 13:53:36,588::task::568::TaskManager.Task::(_updateState) Task=`821c3dc2-5f16-4474-92b2-442b48081007`::moving from state preparing -> state finished >Thread-99::DEBUG::2012-11-29 13:53:36,588::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-99::DEBUG::2012-11-29 13:53:36,589::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-99::DEBUG::2012-11-29 13:53:36,589::task::957::TaskManager.Task::(_decref) Task=`821c3dc2-5f16-4474-92b2-442b48081007`::ref 0 aborting False >Thread-100::DEBUG::2012-11-29 13:53:37,618::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-100::DEBUG::2012-11-29 13:53:37,618::task::568::TaskManager.Task::(_updateState) Task=`77f8fc29-c6a2-4942-9c86-882fbc2f667b`::moving from state init -> state preparing >Thread-100::INFO::2012-11-29 13:53:37,619::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-100::DEBUG::2012-11-29 13:53:37,619::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-100::DEBUG::2012-11-29 13:53:37,619::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-100::INFO::2012-11-29 13:53:37,619::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-100::DEBUG::2012-11-29 13:53:37,619::task::1151::TaskManager.Task::(prepare) Task=`77f8fc29-c6a2-4942-9c86-882fbc2f667b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-100::DEBUG::2012-11-29 13:53:37,619::task::568::TaskManager.Task::(_updateState) Task=`77f8fc29-c6a2-4942-9c86-882fbc2f667b`::moving from state preparing -> state finished >Thread-100::DEBUG::2012-11-29 13:53:37,620::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-100::DEBUG::2012-11-29 13:53:37,620::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-100::DEBUG::2012-11-29 13:53:37,620::task::957::TaskManager.Task::(_decref) Task=`77f8fc29-c6a2-4942-9c86-882fbc2f667b`::ref 0 aborting False >Thread-102::DEBUG::2012-11-29 13:53:38,648::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-102::DEBUG::2012-11-29 13:53:38,648::task::568::TaskManager.Task::(_updateState) Task=`756f045b-9565-431f-8a70-a6bae2919be7`::moving from state init -> state preparing >Thread-102::INFO::2012-11-29 13:53:38,648::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-102::DEBUG::2012-11-29 13:53:38,649::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-102::DEBUG::2012-11-29 13:53:38,649::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-102::INFO::2012-11-29 13:53:38,649::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-102::DEBUG::2012-11-29 13:53:38,649::task::1151::TaskManager.Task::(prepare) Task=`756f045b-9565-431f-8a70-a6bae2919be7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-102::DEBUG::2012-11-29 13:53:38,649::task::568::TaskManager.Task::(_updateState) Task=`756f045b-9565-431f-8a70-a6bae2919be7`::moving from state preparing -> state finished >Thread-102::DEBUG::2012-11-29 13:53:38,649::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2012-11-29 13:53:38,649::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2012-11-29 13:53:38,650::task::957::TaskManager.Task::(_decref) Task=`756f045b-9565-431f-8a70-a6bae2919be7`::ref 0 aborting False >Thread-103::DEBUG::2012-11-29 13:53:39,696::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-103::DEBUG::2012-11-29 13:53:39,696::task::568::TaskManager.Task::(_updateState) Task=`ef4df182-1bfb-4a40-9e5f-52ccc11a16f3`::moving from state init -> state preparing >Thread-103::INFO::2012-11-29 13:53:39,697::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-103::DEBUG::2012-11-29 13:53:39,697::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-103::DEBUG::2012-11-29 13:53:39,697::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-103::INFO::2012-11-29 13:53:39,697::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-103::DEBUG::2012-11-29 13:53:39,697::task::1151::TaskManager.Task::(prepare) Task=`ef4df182-1bfb-4a40-9e5f-52ccc11a16f3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-103::DEBUG::2012-11-29 13:53:39,697::task::568::TaskManager.Task::(_updateState) Task=`ef4df182-1bfb-4a40-9e5f-52ccc11a16f3`::moving from state preparing -> state finished >Thread-103::DEBUG::2012-11-29 13:53:39,697::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-103::DEBUG::2012-11-29 13:53:39,698::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-103::DEBUG::2012-11-29 13:53:39,698::task::957::TaskManager.Task::(_decref) Task=`ef4df182-1bfb-4a40-9e5f-52ccc11a16f3`::ref 0 aborting False >Thread-105::DEBUG::2012-11-29 13:53:40,727::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-105::DEBUG::2012-11-29 13:53:40,728::task::568::TaskManager.Task::(_updateState) Task=`0b3df35e-7fe4-4e93-a5b1-99db12378524`::moving from state init -> state preparing >Thread-105::INFO::2012-11-29 13:53:40,728::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-105::DEBUG::2012-11-29 13:53:40,728::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-105::DEBUG::2012-11-29 13:53:40,728::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-105::INFO::2012-11-29 13:53:40,728::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-105::DEBUG::2012-11-29 13:53:40,728::task::1151::TaskManager.Task::(prepare) Task=`0b3df35e-7fe4-4e93-a5b1-99db12378524`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-105::DEBUG::2012-11-29 13:53:40,729::task::568::TaskManager.Task::(_updateState) Task=`0b3df35e-7fe4-4e93-a5b1-99db12378524`::moving from state preparing -> state finished >Thread-105::DEBUG::2012-11-29 13:53:40,729::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-105::DEBUG::2012-11-29 13:53:40,729::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-105::DEBUG::2012-11-29 13:53:40,729::task::957::TaskManager.Task::(_decref) Task=`0b3df35e-7fe4-4e93-a5b1-99db12378524`::ref 0 aborting False >Thread-106::DEBUG::2012-11-29 13:53:41,760::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-106::DEBUG::2012-11-29 13:53:41,760::task::568::TaskManager.Task::(_updateState) Task=`251b848d-0b72-43db-97fa-5e88cc3cd222`::moving from state init -> state preparing >Thread-106::INFO::2012-11-29 13:53:41,761::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-106::DEBUG::2012-11-29 13:53:41,761::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-106::DEBUG::2012-11-29 13:53:41,761::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-106::INFO::2012-11-29 13:53:41,761::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-106::DEBUG::2012-11-29 13:53:41,761::task::1151::TaskManager.Task::(prepare) Task=`251b848d-0b72-43db-97fa-5e88cc3cd222`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-106::DEBUG::2012-11-29 13:53:41,761::task::568::TaskManager.Task::(_updateState) Task=`251b848d-0b72-43db-97fa-5e88cc3cd222`::moving from state preparing -> state finished >Thread-106::DEBUG::2012-11-29 13:53:41,761::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-106::DEBUG::2012-11-29 13:53:41,762::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-106::DEBUG::2012-11-29 13:53:41,762::task::957::TaskManager.Task::(_decref) Task=`251b848d-0b72-43db-97fa-5e88cc3cd222`::ref 0 aborting False >Thread-107::DEBUG::2012-11-29 13:53:42,504::task::568::TaskManager.Task::(_updateState) Task=`d55afdce-48f0-4b29-8d5a-452babaafcb6`::moving from state init -> state preparing >Thread-107::INFO::2012-11-29 13:53:42,504::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-107::INFO::2012-11-29 13:53:42,504::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00210809707642', 'lastCheck': '18.5', 'code': 0, 'valid': True}} >Thread-107::DEBUG::2012-11-29 13:53:42,505::task::1151::TaskManager.Task::(prepare) Task=`d55afdce-48f0-4b29-8d5a-452babaafcb6`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00210809707642', 'lastCheck': '18.5', 'code': 0, 'valid': True}} >Thread-107::DEBUG::2012-11-29 13:53:42,505::task::568::TaskManager.Task::(_updateState) Task=`d55afdce-48f0-4b29-8d5a-452babaafcb6`::moving from state preparing -> state finished >Thread-107::DEBUG::2012-11-29 13:53:42,505::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-107::DEBUG::2012-11-29 13:53:42,505::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-107::DEBUG::2012-11-29 13:53:42,505::task::957::TaskManager.Task::(_decref) Task=`d55afdce-48f0-4b29-8d5a-452babaafcb6`::ref 0 aborting False >Thread-109::DEBUG::2012-11-29 13:53:42,791::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-109::DEBUG::2012-11-29 13:53:42,791::task::568::TaskManager.Task::(_updateState) Task=`53af7115-7153-486f-a16c-cec8bc052509`::moving from state init -> state preparing >Thread-109::INFO::2012-11-29 13:53:42,791::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-109::DEBUG::2012-11-29 13:53:42,791::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-109::DEBUG::2012-11-29 13:53:42,791::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-109::INFO::2012-11-29 13:53:42,792::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-109::DEBUG::2012-11-29 13:53:42,792::task::1151::TaskManager.Task::(prepare) Task=`53af7115-7153-486f-a16c-cec8bc052509`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-109::DEBUG::2012-11-29 13:53:42,792::task::568::TaskManager.Task::(_updateState) Task=`53af7115-7153-486f-a16c-cec8bc052509`::moving from state preparing -> state finished >Thread-109::DEBUG::2012-11-29 13:53:42,792::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-109::DEBUG::2012-11-29 13:53:42,792::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-109::DEBUG::2012-11-29 13:53:42,792::task::957::TaskManager.Task::(_decref) Task=`53af7115-7153-486f-a16c-cec8bc052509`::ref 0 aborting False >Thread-110::DEBUG::2012-11-29 13:53:43,821::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-110::DEBUG::2012-11-29 13:53:43,821::task::568::TaskManager.Task::(_updateState) Task=`7900e073-e0bc-4cf8-bbb8-b183c21459bb`::moving from state init -> state preparing >Thread-110::INFO::2012-11-29 13:53:43,821::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-110::DEBUG::2012-11-29 13:53:43,822::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-110::DEBUG::2012-11-29 13:53:43,822::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-110::INFO::2012-11-29 13:53:43,822::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-110::DEBUG::2012-11-29 13:53:43,822::task::1151::TaskManager.Task::(prepare) Task=`7900e073-e0bc-4cf8-bbb8-b183c21459bb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-110::DEBUG::2012-11-29 13:53:43,822::task::568::TaskManager.Task::(_updateState) Task=`7900e073-e0bc-4cf8-bbb8-b183c21459bb`::moving from state preparing -> state finished >Thread-110::DEBUG::2012-11-29 13:53:43,822::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-110::DEBUG::2012-11-29 13:53:43,822::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-110::DEBUG::2012-11-29 13:53:43,823::task::957::TaskManager.Task::(_decref) Task=`7900e073-e0bc-4cf8-bbb8-b183c21459bb`::ref 0 aborting False >Thread-112::DEBUG::2012-11-29 13:53:44,851::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-112::DEBUG::2012-11-29 13:53:44,852::task::568::TaskManager.Task::(_updateState) Task=`8ff7321c-c42e-4898-af50-8d497f001fb7`::moving from state init -> state preparing >Thread-112::INFO::2012-11-29 13:53:44,852::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-112::DEBUG::2012-11-29 13:53:44,852::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-112::DEBUG::2012-11-29 13:53:44,852::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-112::INFO::2012-11-29 13:53:44,852::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-112::DEBUG::2012-11-29 13:53:44,853::task::1151::TaskManager.Task::(prepare) Task=`8ff7321c-c42e-4898-af50-8d497f001fb7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-112::DEBUG::2012-11-29 13:53:44,853::task::568::TaskManager.Task::(_updateState) Task=`8ff7321c-c42e-4898-af50-8d497f001fb7`::moving from state preparing -> state finished >Thread-112::DEBUG::2012-11-29 13:53:44,853::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-112::DEBUG::2012-11-29 13:53:44,853::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-112::DEBUG::2012-11-29 13:53:44,853::task::957::TaskManager.Task::(_decref) Task=`8ff7321c-c42e-4898-af50-8d497f001fb7`::ref 0 aborting False >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,224::safelease::178::SANLock::(acquireHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully acquired (id: 1) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::INFO::2012-11-29 13:53:45,224::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 1) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,260::safelease::235::SANLock::(acquire) Cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully acquired (id: 1) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,260::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,264::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=962ac5a59051d8e733fc302f35acc98af2be71bb'] >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,264::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,264::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,264::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=0b66b98b54a9d07026b957d57226a05b57bef27e'] >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,270::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,271::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`da9a733f-2031-4cb7-95ef-b54915db4090`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,271::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,271::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,271::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`da9a733f-2031-4cb7-95ef-b54915db4090`::Granted request >58301b23-cd93-4c49-8cd7-6de38f5b36a4::INFO::2012-11-29 13:53:45,271::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `81105f27-0d06-428d-bedf-308ae0109fb5` >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,272::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`cf863ea5-34c4-476a-aa61-d241c1a259c5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,272::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'exclusive' >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,272::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'exclusive' (1 active user) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,272::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`cf863ea5-34c4-476a-aa61-d241c1a259c5`::Granted request >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,273::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,273::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 81105f27-0d06-428d-bedf-308ae0109fb5' (cwd None) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,424::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found\n'; <rc> = 5 >58301b23-cd93-4c49-8cd7-6de38f5b36a4::WARNING::2012-11-29 13:53:45,424::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found'] >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,425::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,436::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,437::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,440::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=0b66b98b54a9d07026b957d57226a05b57bef27e'] >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,441::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >58301b23-cd93-4c49-8cd7-6de38f5b36a4::WARNING::2012-11-29 13:53:45,442::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_imageNS already registered >58301b23-cd93-4c49-8cd7-6de38f5b36a4::WARNING::2012-11-29 13:53:45,442::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS already registered >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,442::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,442::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,443::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,443::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,443::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,443::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,443::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,444::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,444::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,444::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,444::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >58301b23-cd93-4c49-8cd7-6de38f5b36a4::WARNING::2012-11-29 13:53:45,446::sd::590::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5/master/vms) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::WARNING::2012-11-29 13:53:45,447::sd::595::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5/master/tasks) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,451::sp::309::Storage.StoragePool::(startSpm) ended. >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,451::task::568::TaskManager.Task::(_updateState) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::moving from state running -> state finished >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,451::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,451::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,452::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,452::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,452::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,452::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,453::task::880::TaskManager.Task::(_runJobs) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::Task.run: exit - success: result >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,453::task::957::TaskManager.Task::(_decref) Task=`58301b23-cd93-4c49-8cd7-6de38f5b36a4`::ref 0 aborting False >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:45,453::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-118::DEBUG::2012-11-29 13:53:45,884::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-118::DEBUG::2012-11-29 13:53:45,885::task::568::TaskManager.Task::(_updateState) Task=`36fddd53-e36b-428b-a47f-489c2e995037`::moving from state init -> state preparing >Thread-118::INFO::2012-11-29 13:53:45,885::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-118::DEBUG::2012-11-29 13:53:45,885::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-118::DEBUG::2012-11-29 13:53:45,885::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'} >Thread-118::INFO::2012-11-29 13:53:45,886::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-118::DEBUG::2012-11-29 13:53:45,886::task::1151::TaskManager.Task::(prepare) Task=`36fddd53-e36b-428b-a47f-489c2e995037`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '58301b23-cd93-4c49-8cd7-6de38f5b36a4'}} >Thread-118::DEBUG::2012-11-29 13:53:45,886::task::568::TaskManager.Task::(_updateState) Task=`36fddd53-e36b-428b-a47f-489c2e995037`::moving from state preparing -> state finished >Thread-118::DEBUG::2012-11-29 13:53:45,886::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-118::DEBUG::2012-11-29 13:53:45,886::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-118::DEBUG::2012-11-29 13:53:45,887::task::957::TaskManager.Task::(_decref) Task=`36fddd53-e36b-428b-a47f-489c2e995037`::ref 0 aborting False >Thread-119::DEBUG::2012-11-29 13:53:45,914::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-119::DEBUG::2012-11-29 13:53:45,915::task::568::TaskManager.Task::(_updateState) Task=`8ab8a6f1-8a4f-4d22-a94a-7302e67845cd`::moving from state init -> state preparing >Thread-119::INFO::2012-11-29 13:53:45,915::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-119::INFO::2012-11-29 13:53:45,915::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-119::DEBUG::2012-11-29 13:53:45,916::task::1151::TaskManager.Task::(prepare) Task=`8ab8a6f1-8a4f-4d22-a94a-7302e67845cd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-119::DEBUG::2012-11-29 13:53:45,916::task::568::TaskManager.Task::(_updateState) Task=`8ab8a6f1-8a4f-4d22-a94a-7302e67845cd`::moving from state preparing -> state finished >Thread-119::DEBUG::2012-11-29 13:53:45,916::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-119::DEBUG::2012-11-29 13:53:45,916::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-119::DEBUG::2012-11-29 13:53:45,916::task::957::TaskManager.Task::(_decref) Task=`8ab8a6f1-8a4f-4d22-a94a-7302e67845cd`::ref 0 aborting False >Thread-120::DEBUG::2012-11-29 13:53:45,961::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-120::DEBUG::2012-11-29 13:53:45,961::task::568::TaskManager.Task::(_updateState) Task=`bfbeecc7-2992-4167-a2f3-5968d9c29204`::moving from state init -> state preparing >Thread-120::INFO::2012-11-29 13:53:45,961::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='58301b23-cd93-4c49-8cd7-6de38f5b36a4', spUUID=None, options=None) >Thread-120::DEBUG::2012-11-29 13:53:45,962::taskManager::161::TaskManager::(clearTask) Entry. taskID: 58301b23-cd93-4c49-8cd7-6de38f5b36a4 >Thread-120::DEBUG::2012-11-29 13:53:45,962::taskManager::166::TaskManager::(clearTask) Return. >Thread-120::INFO::2012-11-29 13:53:45,962::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-120::DEBUG::2012-11-29 13:53:45,962::task::1151::TaskManager.Task::(prepare) Task=`bfbeecc7-2992-4167-a2f3-5968d9c29204`::finished: None >Thread-120::DEBUG::2012-11-29 13:53:45,962::task::568::TaskManager.Task::(_updateState) Task=`bfbeecc7-2992-4167-a2f3-5968d9c29204`::moving from state preparing -> state finished >Thread-120::DEBUG::2012-11-29 13:53:45,963::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-120::DEBUG::2012-11-29 13:53:45,963::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-120::DEBUG::2012-11-29 13:53:45,963::task::957::TaskManager.Task::(_decref) Task=`bfbeecc7-2992-4167-a2f3-5968d9c29204`::ref 0 aborting False >Thread-121::DEBUG::2012-11-29 13:53:46,013::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-121::DEBUG::2012-11-29 13:53:46,014::task::568::TaskManager.Task::(_updateState) Task=`751777f6-cd15-4d68-82a7-86f63787db02`::moving from state init -> state preparing >Thread-121::INFO::2012-11-29 13:53:46,014::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-121::DEBUG::2012-11-29 13:53:46,014::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`e3d9f8f3-8c04-48aa-a107-b2f2178fa77f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-121::DEBUG::2012-11-29 13:53:46,014::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-121::DEBUG::2012-11-29 13:53:46,015::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-121::DEBUG::2012-11-29 13:53:46,015::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`e3d9f8f3-8c04-48aa-a107-b2f2178fa77f`::Granted request >Thread-121::DEBUG::2012-11-29 13:53:46,015::task::794::TaskManager.Task::(resourceAcquired) Task=`751777f6-cd15-4d68-82a7-86f63787db02`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (exclusive) >Thread-121::DEBUG::2012-11-29 13:53:46,015::task::957::TaskManager.Task::(_decref) Task=`751777f6-cd15-4d68-82a7-86f63787db02`::ref 1 aborting False >Thread-121::DEBUG::2012-11-29 13:53:46,016::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`c382295c-a55d-4b70-bfd8-88ef5f7d956b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-121::DEBUG::2012-11-29 13:53:46,016::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'exclusive' >Thread-121::DEBUG::2012-11-29 13:53:46,016::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'exclusive' (1 active user) >Thread-121::DEBUG::2012-11-29 13:53:46,016::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`c382295c-a55d-4b70-bfd8-88ef5f7d956b`::Granted request >Thread-121::DEBUG::2012-11-29 13:53:46,017::task::794::TaskManager.Task::(resourceAcquired) Task=`751777f6-cd15-4d68-82a7-86f63787db02`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (exclusive) >Thread-121::DEBUG::2012-11-29 13:53:46,017::task::957::TaskManager.Task::(_decref) Task=`751777f6-cd15-4d68-82a7-86f63787db02`::ref 1 aborting False >Thread-121::INFO::2012-11-29 13:53:46,017::sp::1045::Storage.StoragePool::(activateSD) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b >Thread-121::INFO::2012-11-29 13:53:46,017::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-121::DEBUG::2012-11-29 13:53:46,018::task::1151::TaskManager.Task::(prepare) Task=`751777f6-cd15-4d68-82a7-86f63787db02`::finished: None >Thread-121::DEBUG::2012-11-29 13:53:46,018::task::568::TaskManager.Task::(_updateState) Task=`751777f6-cd15-4d68-82a7-86f63787db02`::moving from state preparing -> state finished >Thread-121::DEBUG::2012-11-29 13:53:46,018::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>, 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-121::DEBUG::2012-11-29 13:53:46,018::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-121::DEBUG::2012-11-29 13:53:46,018::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-121::DEBUG::2012-11-29 13:53:46,019::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-121::DEBUG::2012-11-29 13:53:46,019::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-121::DEBUG::2012-11-29 13:53:46,019::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-121::DEBUG::2012-11-29 13:53:46,019::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-121::DEBUG::2012-11-29 13:53:46,019::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-121::DEBUG::2012-11-29 13:53:46,020::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-121::DEBUG::2012-11-29 13:53:46,020::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-121::DEBUG::2012-11-29 13:53:46,020::task::957::TaskManager.Task::(_decref) Task=`751777f6-cd15-4d68-82a7-86f63787db02`::ref 0 aborting False >Thread-122::DEBUG::2012-11-29 13:53:46,079::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-122::DEBUG::2012-11-29 13:53:46,079::task::568::TaskManager.Task::(_updateState) Task=`f8d62558-9b1d-438c-ae22-6cea5d405f03`::moving from state init -> state preparing >Thread-122::INFO::2012-11-29 13:53:46,079::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', hostID=1, scsiKey='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', msdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', masterVersion=1, options=None) >Thread-122::DEBUG::2012-11-29 13:53:46,080::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`d00c2a93-3969-4ce3-ba51-4ee0fb03c37f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-122::DEBUG::2012-11-29 13:53:46,080::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-122::DEBUG::2012-11-29 13:53:46,080::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-122::DEBUG::2012-11-29 13:53:46,080::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`d00c2a93-3969-4ce3-ba51-4ee0fb03c37f`::Granted request >Thread-122::DEBUG::2012-11-29 13:53:46,081::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 81105f27-0d06-428d-bedf-308ae0109fb5 verified, version 1 >Thread-122::DEBUG::2012-11-29 13:53:46,081::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-122::DEBUG::2012-11-29 13:53:46,081::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-122::DEBUG::2012-11-29 13:53:46,082::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-122::DEBUG::2012-11-29 13:53:46,082::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-122::INFO::2012-11-29 13:53:46,082::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-122::DEBUG::2012-11-29 13:53:46,082::task::1151::TaskManager.Task::(prepare) Task=`f8d62558-9b1d-438c-ae22-6cea5d405f03`::finished: None >Thread-122::DEBUG::2012-11-29 13:53:46,082::task::568::TaskManager.Task::(_updateState) Task=`f8d62558-9b1d-438c-ae22-6cea5d405f03`::moving from state preparing -> state finished >Thread-122::DEBUG::2012-11-29 13:53:46,083::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-122::DEBUG::2012-11-29 13:53:46,083::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-122::DEBUG::2012-11-29 13:53:46,083::task::957::TaskManager.Task::(_decref) Task=`f8d62558-9b1d-438c-ae22-6cea5d405f03`::ref 0 aborting False >Thread-124::DEBUG::2012-11-29 13:53:47,119::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-124::DEBUG::2012-11-29 13:53:47,119::task::568::TaskManager.Task::(_updateState) Task=`846d419c-638c-4e8a-afc2-3061c685135b`::moving from state init -> state preparing >Thread-124::INFO::2012-11-29 13:53:47,119::logUtils::37::dispatcher::(wrapper) Run and protect: setStorageDomainDescription(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', description='DataDomainRestUpd', options=None) >Thread-124::DEBUG::2012-11-29 13:53:47,120::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`4b591434-353b-4a61-bbba-f05a5e7bc735`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-124::DEBUG::2012-11-29 13:53:47,120::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'exclusive' >Thread-124::DEBUG::2012-11-29 13:53:47,120::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'exclusive' (1 active user) >Thread-124::DEBUG::2012-11-29 13:53:47,120::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`4b591434-353b-4a61-bbba-f05a5e7bc735`::Granted request >Thread-124::DEBUG::2012-11-29 13:53:47,121::task::794::TaskManager.Task::(resourceAcquired) Task=`846d419c-638c-4e8a-afc2-3061c685135b`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (exclusive) >Thread-124::DEBUG::2012-11-29 13:53:47,121::task::957::TaskManager.Task::(_decref) Task=`846d419c-638c-4e8a-afc2-3061c685135b`::ref 1 aborting False >Thread-124::INFO::2012-11-29 13:53:47,121::sd::647::Storage.StorageDomain::(setDescription) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 descr=DataDomainRestUpd >Thread-124::DEBUG::2012-11-29 13:53:47,121::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-124::DEBUG::2012-11-29 13:53:47,121::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-124::DEBUG::2012-11-29 13:53:47,122::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9ac9b8816517dc36c03957538bcd105774acb179'] >Thread-124::DEBUG::2012-11-29 13:53:47,125::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-124::INFO::2012-11-29 13:53:47,125::logUtils::39::dispatcher::(wrapper) Run and protect: setStorageDomainDescription, Return response: None >Thread-124::DEBUG::2012-11-29 13:53:47,126::task::1151::TaskManager.Task::(prepare) Task=`846d419c-638c-4e8a-afc2-3061c685135b`::finished: None >Thread-124::DEBUG::2012-11-29 13:53:47,126::task::568::TaskManager.Task::(_updateState) Task=`846d419c-638c-4e8a-afc2-3061c685135b`::moving from state preparing -> state finished >Thread-124::DEBUG::2012-11-29 13:53:47,126::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >Thread-124::DEBUG::2012-11-29 13:53:47,126::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-124::DEBUG::2012-11-29 13:53:47,126::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-124::DEBUG::2012-11-29 13:53:47,127::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-124::DEBUG::2012-11-29 13:53:47,127::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-124::DEBUG::2012-11-29 13:53:47,127::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-124::DEBUG::2012-11-29 13:53:47,127::task::957::TaskManager.Task::(_decref) Task=`846d419c-638c-4e8a-afc2-3061c685135b`::ref 0 aborting False >Thread-127::DEBUG::2012-11-29 13:53:52,687::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-127::DEBUG::2012-11-29 13:53:52,687::task::568::TaskManager.Task::(_updateState) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::moving from state init -> state preparing >Thread-127::INFO::2012-11-29 13:53:52,687::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', imgUUID='611ff093-4634-467b-be1f-e415069ceb71', size='2147483648', volFormat=4, preallocate=2, diskType=2, volUUID='3c9b8a70-d380-46c2-857b-beaa9782dc1c', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-127::INFO::2012-11-29 13:53:52,687::fileSD::302::Storage.StorageDomain::(validate) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-127::DEBUG::2012-11-29 13:53:52,691::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9ac9b8816517dc36c03957538bcd105774acb179'] >Thread-127::DEBUG::2012-11-29 13:53:52,691::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`d234f41e-bf9b-4355-84ba-4b6286b12a2c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-127::DEBUG::2012-11-29 13:53:52,691::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-127::DEBUG::2012-11-29 13:53:52,692::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-127::DEBUG::2012-11-29 13:53:52,692::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`d234f41e-bf9b-4355-84ba-4b6286b12a2c`::Granted request >Thread-127::DEBUG::2012-11-29 13:53:52,692::task::794::TaskManager.Task::(resourceAcquired) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-127::DEBUG::2012-11-29 13:53:52,692::task::957::TaskManager.Task::(_decref) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::ref 1 aborting False >Thread-127::DEBUG::2012-11-29 13:53:52,694::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >Thread-127::DEBUG::2012-11-29 13:53:52,703::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 2d5e6d11-4690-49dc-a404-dcc1a82541ec >Thread-127::INFO::2012-11-29 13:53:52,703::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-127::DEBUG::2012-11-29 13:53:52,703::task::1146::TaskManager.Task::(prepare) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::Prepare: 1 jobs exist, move to acquiring >Thread-127::DEBUG::2012-11-29 13:53:52,703::task::568::TaskManager.Task::(_updateState) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::moving from state preparing -> state acquiring >Thread-127::DEBUG::2012-11-29 13:53:52,704::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >Thread-128::DEBUG::2012-11-29 13:53:52,712::task::568::TaskManager.Task::(_updateState) Task=`57694108-d32e-48d9-9570-c5b4d1a8d403`::moving from state init -> state preparing >Thread-128::INFO::2012-11-29 13:53:52,712::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-128::INFO::2012-11-29 13:53:52,712::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00229811668396', 'lastCheck': '7.5', 'code': 0, 'valid': True}} >Thread-128::DEBUG::2012-11-29 13:53:52,713::task::1151::TaskManager.Task::(prepare) Task=`57694108-d32e-48d9-9570-c5b4d1a8d403`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00229811668396', 'lastCheck': '7.5', 'code': 0, 'valid': True}} >Thread-128::DEBUG::2012-11-29 13:53:52,713::task::568::TaskManager.Task::(_updateState) Task=`57694108-d32e-48d9-9570-c5b4d1a8d403`::moving from state preparing -> state finished >Thread-128::DEBUG::2012-11-29 13:53:52,713::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-128::DEBUG::2012-11-29 13:53:52,713::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-128::DEBUG::2012-11-29 13:53:52,713::task::957::TaskManager.Task::(_decref) Task=`57694108-d32e-48d9-9570-c5b4d1a8d403`::ref 0 aborting False >Thread-127::DEBUG::2012-11-29 13:53:52,716::task::568::TaskManager.Task::(_updateState) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::moving from state acquiring -> state queued >Thread-127::DEBUG::2012-11-29 13:53:52,716::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >Thread-127::DEBUG::2012-11-29 13:53:52,728::taskManager::50::TaskManager::(_queueTask) queuing task: 2d5e6d11-4690-49dc-a404-dcc1a82541ec >Thread-127::DEBUG::2012-11-29 13:53:52,729::taskManager::56::TaskManager::(_queueTask) task queued: 2d5e6d11-4690-49dc-a404-dcc1a82541ec >58301b23-cd93-4c49-8cd7-6de38f5b36a4::DEBUG::2012-11-29 13:53:52,729::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-127::DEBUG::2012-11-29 13:53:52,729::task::1148::TaskManager.Task::(prepare) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::returning >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,729::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 2d5e6d11-4690-49dc-a404-dcc1a82541ec running: <bound method Task.commit of <storage.task.Task instance at 0x7f417c26ccb0>> with: None >Thread-127::DEBUG::2012-11-29 13:53:52,729::task::957::TaskManager.Task::(_decref) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::ref 0 aborting False >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,730::task::1159::TaskManager.Task::(commit) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::committing task: 2d5e6d11-4690-49dc-a404-dcc1a82541ec >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,730::task::568::TaskManager.Task::(_updateState) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::moving from state queued -> state running >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,731::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,743::task::872::TaskManager.Task::(_runJobs) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f417c25a290>> (args: ('81105f27-0d06-428d-bedf-308ae0109fb5', '611ff093-4634-467b-be1f-e415069ceb71', 4194304, 4, 2, 2, '3c9b8a70-d380-46c2-857b-beaa9782dc1c', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,743::task::304::TaskManager.Task::(run) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f417c25a290>> (args: ('81105f27-0d06-428d-bedf-308ae0109fb5', '611ff093-4634-467b-be1f-e415069ceb71', 4194304, 4, 2, 2, '3c9b8a70-d380-46c2-857b-beaa9782dc1c', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,743::resourceManager::175::ResourceManager.Request::(__init__) ResName=`81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71`ReqID=`ac04fa5e-bcb4-4f37-9a8f-f255453cb08c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,743::resourceManager::486::ResourceManager::(registerResource) Trying to register resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' for lock type 'exclusive' >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,744::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 611ff093-4634-467b-be1f-e415069ceb71 does not exist in domain 81105f27-0d06-428d-bedf-308ae0109fb5 >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,744::resourceManager::528::ResourceManager::(registerResource) Resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' is free. Now locking as 'exclusive' (1 active user) >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,744::resourceManager::212::ResourceManager.Request::(grant) ResName=`81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71`ReqID=`ac04fa5e-bcb4-4f37-9a8f-f255453cb08c`::Granted request >2d5e6d11-4690-49dc-a404-dcc1a82541ec::INFO::2012-11-29 13:53:52,745::image::119::Storage.Image::(create) Create placeholder /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/611ff093-4634-467b-be1f-e415069ceb71 for image's volumes >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,745::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >2d5e6d11-4690-49dc-a404-dcc1a82541ec::INFO::2012-11-29 13:53:52,760::volume::457::Storage.Volume::(create) Creating volume 3c9b8a70-d380-46c2-857b-beaa9782dc1c >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,761::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,776::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >2d5e6d11-4690-49dc-a404-dcc1a82541ec::INFO::2012-11-29 13:53:52,794::fileVolume::153::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c with size = 4194304 sectors >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,794::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c 2097152K' (cwd None) >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,819::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,883::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,907::fileVolume::401::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=3c9b8a70-d380-46c2-857b-beaa9782dc1c sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5, metaId=('/rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c',) >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,928::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,946::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,946::resourceManager::553::ResourceManager::(releaseResource) Released resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' (0 active users) >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,946::resourceManager::558::ResourceManager::(releaseResource) Resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' is free, finding out if anyone is waiting for it. >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,946::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71', Clearing records. >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,947::task::568::TaskManager.Task::(_updateState) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::moving from state running -> state finished >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,947::task::719::TaskManager.Task::(_save) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/2d5e6d11-4690-49dc-a404-dcc1a82541ec.temp >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,965::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,965::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,965::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,965::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,966::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,966::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,966::task::880::TaskManager.Task::(_runJobs) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::Task.run: exit - success: result {'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c'} >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,966::task::957::TaskManager.Task::(_decref) Task=`2d5e6d11-4690-49dc-a404-dcc1a82541ec`::ref 0 aborting False >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:53:52,966::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-131::DEBUG::2012-11-29 13:53:56,061::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-131::DEBUG::2012-11-29 13:53:56,062::task::568::TaskManager.Task::(_updateState) Task=`70b0a586-9035-4fa0-b04d-821fcc7d377b`::moving from state init -> state preparing >Thread-131::INFO::2012-11-29 13:53:56,062::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-131::INFO::2012-11-29 13:53:56,062::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-131::DEBUG::2012-11-29 13:53:56,062::task::1151::TaskManager.Task::(prepare) Task=`70b0a586-9035-4fa0-b04d-821fcc7d377b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-131::DEBUG::2012-11-29 13:53:56,063::task::568::TaskManager.Task::(_updateState) Task=`70b0a586-9035-4fa0-b04d-821fcc7d377b`::moving from state preparing -> state finished >Thread-131::DEBUG::2012-11-29 13:53:56,063::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131::DEBUG::2012-11-29 13:53:56,063::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131::DEBUG::2012-11-29 13:53:56,063::task::957::TaskManager.Task::(_decref) Task=`70b0a586-9035-4fa0-b04d-821fcc7d377b`::ref 0 aborting False >Thread-132::DEBUG::2012-11-29 13:53:56,108::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-132::DEBUG::2012-11-29 13:53:56,108::task::568::TaskManager.Task::(_updateState) Task=`7820791b-bd40-4364-975c-599648ef5be7`::moving from state init -> state preparing >Thread-132::INFO::2012-11-29 13:53:56,109::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-132::DEBUG::2012-11-29 13:53:56,109::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`9ae6693d-ab12-4ce9-9cd7-5c321e10066a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-132::DEBUG::2012-11-29 13:53:56,109::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-132::DEBUG::2012-11-29 13:53:56,109::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-132::DEBUG::2012-11-29 13:53:56,109::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`9ae6693d-ab12-4ce9-9cd7-5c321e10066a`::Granted request >Thread-132::DEBUG::2012-11-29 13:53:56,110::task::794::TaskManager.Task::(resourceAcquired) Task=`7820791b-bd40-4364-975c-599648ef5be7`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-132::DEBUG::2012-11-29 13:53:56,110::task::957::TaskManager.Task::(_decref) Task=`7820791b-bd40-4364-975c-599648ef5be7`::ref 1 aborting False >Thread-132::INFO::2012-11-29 13:53:56,112::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859918303232', 'alerts': [], 'disktotal': '859920400384'}}} >Thread-132::DEBUG::2012-11-29 13:53:56,112::task::1151::TaskManager.Task::(prepare) Task=`7820791b-bd40-4364-975c-599648ef5be7`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859918303232', 'alerts': [], 'disktotal': '859920400384'}}} >Thread-132::DEBUG::2012-11-29 13:53:56,112::task::568::TaskManager.Task::(_updateState) Task=`7820791b-bd40-4364-975c-599648ef5be7`::moving from state preparing -> state finished >Thread-132::DEBUG::2012-11-29 13:53:56,113::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-132::DEBUG::2012-11-29 13:53:56,113::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-132::DEBUG::2012-11-29 13:53:56,113::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-132::DEBUG::2012-11-29 13:53:56,113::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-132::DEBUG::2012-11-29 13:53:56,113::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-132::DEBUG::2012-11-29 13:53:56,113::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-132::DEBUG::2012-11-29 13:53:56,114::task::957::TaskManager.Task::(_decref) Task=`7820791b-bd40-4364-975c-599648ef5be7`::ref 0 aborting False >Thread-136::DEBUG::2012-11-29 13:54:01,011::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-136::DEBUG::2012-11-29 13:54:01,012::task::568::TaskManager.Task::(_updateState) Task=`3c4eb9c8-b1a9-49ce-9726-dd0159b99a50`::moving from state init -> state preparing >Thread-136::INFO::2012-11-29 13:54:01,012::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-136::DEBUG::2012-11-29 13:54:01,012::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-136::DEBUG::2012-11-29 13:54:01,012::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d5e6d11-4690-49dc-a404-dcc1a82541ec >Thread-136::DEBUG::2012-11-29 13:54:01,012::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d5e6d11-4690-49dc-a404-dcc1a82541ec'} >Thread-136::DEBUG::2012-11-29 13:54:01,012::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'2d5e6d11-4690-49dc-a404-dcc1a82541ec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d5e6d11-4690-49dc-a404-dcc1a82541ec'}} >Thread-136::INFO::2012-11-29 13:54:01,013::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'2d5e6d11-4690-49dc-a404-dcc1a82541ec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d5e6d11-4690-49dc-a404-dcc1a82541ec'}}} >Thread-136::DEBUG::2012-11-29 13:54:01,013::task::1151::TaskManager.Task::(prepare) Task=`3c4eb9c8-b1a9-49ce-9726-dd0159b99a50`::finished: {'allTasksStatus': {'2d5e6d11-4690-49dc-a404-dcc1a82541ec': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d5e6d11-4690-49dc-a404-dcc1a82541ec'}}} >Thread-136::DEBUG::2012-11-29 13:54:01,013::task::568::TaskManager.Task::(_updateState) Task=`3c4eb9c8-b1a9-49ce-9726-dd0159b99a50`::moving from state preparing -> state finished >Thread-136::DEBUG::2012-11-29 13:54:01,013::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136::DEBUG::2012-11-29 13:54:01,013::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136::DEBUG::2012-11-29 13:54:01,013::task::957::TaskManager.Task::(_decref) Task=`3c4eb9c8-b1a9-49ce-9726-dd0159b99a50`::ref 0 aborting False >Thread-137::DEBUG::2012-11-29 13:54:01,089::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-137::DEBUG::2012-11-29 13:54:01,090::task::568::TaskManager.Task::(_updateState) Task=`4e9a2338-327a-4f49-bed1-080f7bf32884`::moving from state init -> state preparing >Thread-137::INFO::2012-11-29 13:54:01,090::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', imgUUID='611ff093-4634-467b-be1f-e415069ceb71', volUUID='3c9b8a70-d380-46c2-857b-beaa9782dc1c', options=None) >Thread-137::DEBUG::2012-11-29 13:54:01,090::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`f82ce811-6b79-463f-865f-c82d1aa0db84`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-137::DEBUG::2012-11-29 13:54:01,090::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-137::DEBUG::2012-11-29 13:54:01,091::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-137::DEBUG::2012-11-29 13:54:01,091::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`f82ce811-6b79-463f-865f-c82d1aa0db84`::Granted request >Thread-137::DEBUG::2012-11-29 13:54:01,091::task::794::TaskManager.Task::(resourceAcquired) Task=`4e9a2338-327a-4f49-bed1-080f7bf32884`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-137::DEBUG::2012-11-29 13:54:01,091::task::957::TaskManager.Task::(_decref) Task=`4e9a2338-327a-4f49-bed1-080f7bf32884`::ref 1 aborting False >Thread-137::DEBUG::2012-11-29 13:54:01,092::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-137::INFO::2012-11-29 13:54:01,094::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 imgUUID=611ff093-4634-467b-be1f-e415069ceb71 volUUID = 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-137::DEBUG::2012-11-29 13:54:01,105::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-137::DEBUG::2012-11-29 13:54:01,108::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-137::INFO::2012-11-29 13:54:01,111::volume::824::Storage.Volume::(getInfo) 81105f27-0d06-428d-bedf-308ae0109fb5/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c info is {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'} >Thread-137::INFO::2012-11-29 13:54:01,111::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-137::DEBUG::2012-11-29 13:54:01,111::task::1151::TaskManager.Task::(prepare) Task=`4e9a2338-327a-4f49-bed1-080f7bf32884`::finished: {'info': {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-137::DEBUG::2012-11-29 13:54:01,111::task::568::TaskManager.Task::(_updateState) Task=`4e9a2338-327a-4f49-bed1-080f7bf32884`::moving from state preparing -> state finished >Thread-137::DEBUG::2012-11-29 13:54:01,112::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >Thread-137::DEBUG::2012-11-29 13:54:01,112::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137::DEBUG::2012-11-29 13:54:01,112::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-137::DEBUG::2012-11-29 13:54:01,112::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-137::DEBUG::2012-11-29 13:54:01,112::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-137::DEBUG::2012-11-29 13:54:01,112::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-137::DEBUG::2012-11-29 13:54:01,113::task::957::TaskManager.Task::(_decref) Task=`4e9a2338-327a-4f49-bed1-080f7bf32884`::ref 0 aborting False >Thread-138::DEBUG::2012-11-29 13:54:01,281::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-138::DEBUG::2012-11-29 13:54:01,282::task::568::TaskManager.Task::(_updateState) Task=`9dc67450-b7bf-4fe5-ab77-a1e327f8b612`::moving from state init -> state preparing >Thread-138::INFO::2012-11-29 13:54:01,282::logUtils::37::dispatcher::(wrapper) Run and protect: updateVM(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', vmList=[{'imglist': '611ff093-4634-467b-be1f-e415069ceb71', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.1.0.0"><References><File ovf:href="611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c" ovf:id="3c9b8a70-d380-46c2-857b-beaa9782dc1c" ovf:size="2147483648" ovf:description="Active VM"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="3c9b8a70-d380-46c2-857b-beaa9782dc1c" ovf:size="2" ovf:actual_size="0" ovf:vm_snapshot_id="b33b9eae-e933-450e-8ccf-2b52edbdb480" ovf:parentRef="" ovf:fileRef="611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="IDE" ovf:boot="false" ovf:disk-alias="restvm_templates_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Name>restvm_templates</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><Description></Description><Domain></Domain><CreationDate>2012/11/29 11:53:48</CreationDate><ExportDate>2012/11/29 11:54:01</ExportDate><IsInitilized>false</IsInitilized><IsAutoSuspend>false</IsAutoSuspend><TimeZone></TimeZone><IsStateless>false</IsStateless><Origin>0</Origin><default_boot_sequence>0</default_boot_sequence><quota_id>00000000-0000-0000-0000-000000000000</quota_id><VmType>0</VmType><DefaultDisplayType>1</DefaultDisplayType><MinAllocatedMem>1024</MinAllocatedMem><Section ovf:id="526eb6ec-81a2-4981-b316-6fa5dd072dee" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>Unassigned</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.1.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>restvm_templates_Disk1</rasd:Caption><rasd:InstanceId>3c9b8a70-d380-46c2-857b-beaa9782dc1c</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>81105f27-0d06-428d-bedf-308ae0109fb5</rasd:StorageId><rasd:StoragePoolId>1354c897-ef7d-4edf-aa4c-c1e1464d0e2b</rasd:StoragePoolId><rasd:CreationDate>2012/11/29 11:53:52</rasd:CreationDate><rasd:LastModified>2012/11/29 11:53:52</rasd:LastModified><rasd:last_modified_date>2012/11/29 11:54:01</rasd:last_modified_date></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>\n', 'vm': '526eb6ec-81a2-4981-b316-6fa5dd072dee'}], sdUUID=None, options=None) >Thread-138::DEBUG::2012-11-29 13:54:01,283::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`d5bef713-ba68-49b3-9697-912b030151c0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-138::DEBUG::2012-11-29 13:54:01,283::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-138::DEBUG::2012-11-29 13:54:01,283::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-138::DEBUG::2012-11-29 13:54:01,283::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`d5bef713-ba68-49b3-9697-912b030151c0`::Granted request >Thread-138::DEBUG::2012-11-29 13:54:01,283::task::794::TaskManager.Task::(resourceAcquired) Task=`9dc67450-b7bf-4fe5-ab77-a1e327f8b612`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-138::DEBUG::2012-11-29 13:54:01,284::task::957::TaskManager.Task::(_decref) Task=`9dc67450-b7bf-4fe5-ab77-a1e327f8b612`::ref 1 aborting False >Thread-138::INFO::2012-11-29 13:54:01,284::sp::1258::Storage.StoragePool::(updateVM) spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-138::INFO::2012-11-29 13:54:01,284::sp::1269::Storage.StoragePool::(updateVM) vmUUID=526eb6ec-81a2-4981-b316-6fa5dd072dee imgList=['611ff093-4634-467b-be1f-e415069ceb71'] >Thread-138::INFO::2012-11-29 13:54:01,287::logUtils::39::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-138::DEBUG::2012-11-29 13:54:01,288::task::1151::TaskManager.Task::(prepare) Task=`9dc67450-b7bf-4fe5-ab77-a1e327f8b612`::finished: None >Thread-138::DEBUG::2012-11-29 13:54:01,288::task::568::TaskManager.Task::(_updateState) Task=`9dc67450-b7bf-4fe5-ab77-a1e327f8b612`::moving from state preparing -> state finished >Thread-138::DEBUG::2012-11-29 13:54:01,288::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-138::DEBUG::2012-11-29 13:54:01,288::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138::DEBUG::2012-11-29 13:54:01,288::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-138::DEBUG::2012-11-29 13:54:01,289::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-138::DEBUG::2012-11-29 13:54:01,289::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-138::DEBUG::2012-11-29 13:54:01,289::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-138::DEBUG::2012-11-29 13:54:01,289::task::957::TaskManager.Task::(_decref) Task=`9dc67450-b7bf-4fe5-ab77-a1e327f8b612`::ref 0 aborting False >Thread-139::DEBUG::2012-11-29 13:54:01,350::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-139::DEBUG::2012-11-29 13:54:01,350::task::568::TaskManager.Task::(_updateState) Task=`a0b34a72-4e56-4b6d-86d4-0867408cb1e2`::moving from state init -> state preparing >Thread-139::INFO::2012-11-29 13:54:01,350::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='2d5e6d11-4690-49dc-a404-dcc1a82541ec', spUUID=None, options=None) >Thread-139::DEBUG::2012-11-29 13:54:01,351::taskManager::161::TaskManager::(clearTask) Entry. taskID: 2d5e6d11-4690-49dc-a404-dcc1a82541ec >Thread-139::DEBUG::2012-11-29 13:54:01,356::taskManager::166::TaskManager::(clearTask) Return. >Thread-139::INFO::2012-11-29 13:54:01,356::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-139::DEBUG::2012-11-29 13:54:01,356::task::1151::TaskManager.Task::(prepare) Task=`a0b34a72-4e56-4b6d-86d4-0867408cb1e2`::finished: None >Thread-139::DEBUG::2012-11-29 13:54:01,356::task::568::TaskManager.Task::(_updateState) Task=`a0b34a72-4e56-4b6d-86d4-0867408cb1e2`::moving from state preparing -> state finished >Thread-139::DEBUG::2012-11-29 13:54:01,357::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-139::DEBUG::2012-11-29 13:54:01,357::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-139::DEBUG::2012-11-29 13:54:01,357::task::957::TaskManager.Task::(_decref) Task=`a0b34a72-4e56-4b6d-86d4-0867408cb1e2`::ref 0 aborting False >Thread-140::DEBUG::2012-11-29 13:54:02,925::task::568::TaskManager.Task::(_updateState) Task=`c30ce5ad-2a38-49c5-8811-5697fdd5eebd`::moving from state init -> state preparing >Thread-140::INFO::2012-11-29 13:54:02,925::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-140::INFO::2012-11-29 13:54:02,926::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.0021550655365', 'lastCheck': '7.7', 'code': 0, 'valid': True}} >Thread-140::DEBUG::2012-11-29 13:54:02,926::task::1151::TaskManager.Task::(prepare) Task=`c30ce5ad-2a38-49c5-8811-5697fdd5eebd`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.0021550655365', 'lastCheck': '7.7', 'code': 0, 'valid': True}} >Thread-140::DEBUG::2012-11-29 13:54:02,926::task::568::TaskManager.Task::(_updateState) Task=`c30ce5ad-2a38-49c5-8811-5697fdd5eebd`::moving from state preparing -> state finished >Thread-140::DEBUG::2012-11-29 13:54:02,926::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-140::DEBUG::2012-11-29 13:54:02,926::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-140::DEBUG::2012-11-29 13:54:02,926::task::957::TaskManager.Task::(_decref) Task=`c30ce5ad-2a38-49c5-8811-5697fdd5eebd`::ref 0 aborting False >Thread-142::DEBUG::2012-11-29 13:54:04,531::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-142::DEBUG::2012-11-29 13:54:04,531::task::568::TaskManager.Task::(_updateState) Task=`d77bb153-f058-41b8-8ed2-936c26606e2f`::moving from state init -> state preparing >Thread-142::INFO::2012-11-29 13:54:04,531::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', imgUUID='611ff093-4634-467b-be1f-e415069ceb71', volUUID='3c9b8a70-d380-46c2-857b-beaa9782dc1c', options=None) >Thread-142::DEBUG::2012-11-29 13:54:04,532::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`d3aec06b-297d-4865-9765-99598251c53e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-142::DEBUG::2012-11-29 13:54:04,532::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-142::DEBUG::2012-11-29 13:54:04,532::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-142::DEBUG::2012-11-29 13:54:04,532::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`d3aec06b-297d-4865-9765-99598251c53e`::Granted request >Thread-142::DEBUG::2012-11-29 13:54:04,533::task::794::TaskManager.Task::(resourceAcquired) Task=`d77bb153-f058-41b8-8ed2-936c26606e2f`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-142::DEBUG::2012-11-29 13:54:04,533::task::957::TaskManager.Task::(_decref) Task=`d77bb153-f058-41b8-8ed2-936c26606e2f`::ref 1 aborting False >Thread-142::DEBUG::2012-11-29 13:54:04,534::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-142::INFO::2012-11-29 13:54:04,535::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 imgUUID=611ff093-4634-467b-be1f-e415069ceb71 volUUID = 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-142::DEBUG::2012-11-29 13:54:04,545::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-142::DEBUG::2012-11-29 13:54:04,549::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-142::INFO::2012-11-29 13:54:04,551::volume::824::Storage.Volume::(getInfo) 81105f27-0d06-428d-bedf-308ae0109fb5/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c info is {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'} >Thread-142::INFO::2012-11-29 13:54:04,552::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-142::DEBUG::2012-11-29 13:54:04,552::task::1151::TaskManager.Task::(prepare) Task=`d77bb153-f058-41b8-8ed2-936c26606e2f`::finished: {'info': {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-142::DEBUG::2012-11-29 13:54:04,552::task::568::TaskManager.Task::(_updateState) Task=`d77bb153-f058-41b8-8ed2-936c26606e2f`::moving from state preparing -> state finished >Thread-142::DEBUG::2012-11-29 13:54:04,552::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >Thread-142::DEBUG::2012-11-29 13:54:04,552::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-142::DEBUG::2012-11-29 13:54:04,553::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-142::DEBUG::2012-11-29 13:54:04,553::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-142::DEBUG::2012-11-29 13:54:04,553::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-142::DEBUG::2012-11-29 13:54:04,553::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-142::DEBUG::2012-11-29 13:54:04,553::task::957::TaskManager.Task::(_decref) Task=`d77bb153-f058-41b8-8ed2-936c26606e2f`::ref 0 aborting False >Thread-143::DEBUG::2012-11-29 13:54:04,664::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-143::DEBUG::2012-11-29 13:54:04,665::task::568::TaskManager.Task::(_updateState) Task=`ad113192-fd19-4e3e-abc7-fc5e2fc52c77`::moving from state init -> state preparing >Thread-143::INFO::2012-11-29 13:54:04,665::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', imgUUID='611ff093-4634-467b-be1f-e415069ceb71', volUUID='3c9b8a70-d380-46c2-857b-beaa9782dc1c', options=None) >Thread-143::DEBUG::2012-11-29 13:54:04,665::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`e8b4a2b6-f0b7-430e-be14-db04c9294ca4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-143::DEBUG::2012-11-29 13:54:04,665::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-143::DEBUG::2012-11-29 13:54:04,666::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-143::DEBUG::2012-11-29 13:54:04,666::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`e8b4a2b6-f0b7-430e-be14-db04c9294ca4`::Granted request >Thread-143::DEBUG::2012-11-29 13:54:04,666::task::794::TaskManager.Task::(resourceAcquired) Task=`ad113192-fd19-4e3e-abc7-fc5e2fc52c77`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-143::DEBUG::2012-11-29 13:54:04,666::task::957::TaskManager.Task::(_decref) Task=`ad113192-fd19-4e3e-abc7-fc5e2fc52c77`::ref 1 aborting False >Thread-143::DEBUG::2012-11-29 13:54:04,667::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-143::INFO::2012-11-29 13:54:04,668::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 imgUUID=611ff093-4634-467b-be1f-e415069ceb71 volUUID = 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-143::DEBUG::2012-11-29 13:54:04,678::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-143::DEBUG::2012-11-29 13:54:04,682::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-143::INFO::2012-11-29 13:54:04,684::volume::824::Storage.Volume::(getInfo) 81105f27-0d06-428d-bedf-308ae0109fb5/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c info is {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'} >Thread-143::INFO::2012-11-29 13:54:04,685::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-143::DEBUG::2012-11-29 13:54:04,685::task::1151::TaskManager.Task::(prepare) Task=`ad113192-fd19-4e3e-abc7-fc5e2fc52c77`::finished: {'info': {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '611ff093-4634-467b-be1f-e415069ceb71', 'ctime': '1354190032', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190032', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'truesize': '264704', 'type': 'SPARSE'}} >Thread-143::DEBUG::2012-11-29 13:54:04,685::task::568::TaskManager.Task::(_updateState) Task=`ad113192-fd19-4e3e-abc7-fc5e2fc52c77`::moving from state preparing -> state finished >Thread-143::DEBUG::2012-11-29 13:54:04,685::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >Thread-143::DEBUG::2012-11-29 13:54:04,685::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-143::DEBUG::2012-11-29 13:54:04,685::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-143::DEBUG::2012-11-29 13:54:04,686::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-143::DEBUG::2012-11-29 13:54:04,686::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-143::DEBUG::2012-11-29 13:54:04,686::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-143::DEBUG::2012-11-29 13:54:04,686::task::957::TaskManager.Task::(_decref) Task=`ad113192-fd19-4e3e-abc7-fc5e2fc52c77`::ref 0 aborting False >Thread-144::DEBUG::2012-11-29 13:54:04,732::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-144::DEBUG::2012-11-29 13:54:04,732::task::568::TaskManager.Task::(_updateState) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::moving from state init -> state preparing >Thread-144::INFO::2012-11-29 13:54:04,732::logUtils::37::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', vmUUID='', srcImgUUID='611ff093-4634-467b-be1f-e415069ceb71', srcVolUUID='3c9b8a70-d380-46c2-857b-beaa9782dc1c', dstImgUUID='a20a37cd-4d93-4508-a1b3-8180d6a5b753', dstVolUUID='109b1281-b049-4641-ae8b-24a960e34d49', description='Active VM', dstSdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', volType=6, volFormat=4, preallocate=2, postZero='false', force='false') >Thread-144::INFO::2012-11-29 13:54:04,733::fileSD::302::Storage.StorageDomain::(validate) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-144::DEBUG::2012-11-29 13:54:04,735::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9ac9b8816517dc36c03957538bcd105774acb179'] >Thread-144::DEBUG::2012-11-29 13:54:04,737::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-144::INFO::2012-11-29 13:54:04,740::image::457::Storage.Image::(isLegal) image 611ff093-4634-467b-be1f-e415069ceb71 in domain 81105f27-0d06-428d-bedf-308ae0109fb5 has vollist ['3c9b8a70-d380-46c2-857b-beaa9782dc1c'] >Thread-144::DEBUG::2012-11-29 13:54:04,741::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-144::DEBUG::2012-11-29 13:54:04,746::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-144::DEBUG::2012-11-29 13:54:04,749::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-144::DEBUG::2012-11-29 13:54:04,753::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >Thread-144::INFO::2012-11-29 13:54:04,757::image::344::Storage.Image::(getChain) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 imgUUID=611ff093-4634-467b-be1f-e415069ceb71 chain=[<storage.fileVolume.FileVolume object at 0x7f417c35bd10>] >Thread-144::DEBUG::2012-11-29 13:54:04,759::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`8f3fb1b3-84a2-476f-8025-d23d60c9965c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-144::DEBUG::2012-11-29 13:54:04,759::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-144::DEBUG::2012-11-29 13:54:04,759::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-144::DEBUG::2012-11-29 13:54:04,759::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`8f3fb1b3-84a2-476f-8025-d23d60c9965c`::Granted request >Thread-144::DEBUG::2012-11-29 13:54:04,760::task::794::TaskManager.Task::(resourceAcquired) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-144::DEBUG::2012-11-29 13:54:04,760::task::957::TaskManager.Task::(_decref) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::ref 1 aborting False >Thread-144::DEBUG::2012-11-29 13:54:04,761::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >Thread-144::DEBUG::2012-11-29 13:54:04,776::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_a20a37cd-4d93-4508-a1b3-8180d6a5b753 for task 1f0ca577-c0dc-4891-bda6-c545acf15353 >Thread-144::INFO::2012-11-29 13:54:04,776::logUtils::39::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-144::DEBUG::2012-11-29 13:54:04,776::task::1146::TaskManager.Task::(prepare) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::Prepare: 1 jobs exist, move to acquiring >Thread-144::DEBUG::2012-11-29 13:54:04,776::task::568::TaskManager.Task::(_updateState) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::moving from state preparing -> state acquiring >Thread-144::DEBUG::2012-11-29 13:54:04,777::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >Thread-144::DEBUG::2012-11-29 13:54:04,787::task::568::TaskManager.Task::(_updateState) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::moving from state acquiring -> state queued >Thread-144::DEBUG::2012-11-29 13:54:04,788::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >Thread-144::DEBUG::2012-11-29 13:54:04,799::taskManager::50::TaskManager::(_queueTask) queuing task: 1f0ca577-c0dc-4891-bda6-c545acf15353 >Thread-144::DEBUG::2012-11-29 13:54:04,799::taskManager::56::TaskManager::(_queueTask) task queued: 1f0ca577-c0dc-4891-bda6-c545acf15353 >2d5e6d11-4690-49dc-a404-dcc1a82541ec::DEBUG::2012-11-29 13:54:04,800::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-144::DEBUG::2012-11-29 13:54:04,800::task::1148::TaskManager.Task::(prepare) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::returning >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,800::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 1f0ca577-c0dc-4891-bda6-c545acf15353 running: <bound method Task.commit of <storage.task.Task instance at 0x7f417c364fc8>> with: None >Thread-144::DEBUG::2012-11-29 13:54:04,800::task::957::TaskManager.Task::(_decref) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::ref 0 aborting False >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,800::task::1159::TaskManager.Task::(commit) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::committing task: 1f0ca577-c0dc-4891-bda6-c545acf15353 >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,801::task::568::TaskManager.Task::(_updateState) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::moving from state queued -> state running >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,802::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,814::task::872::TaskManager.Task::(_runJobs) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::Task.run: running job 0: copyImage_a20a37cd-4d93-4508-a1b3-8180d6a5b753: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x7f417c25a290>> (args: ('81105f27-0d06-428d-bedf-308ae0109fb5', '', '611ff093-4634-467b-be1f-e415069ceb71', '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'a20a37cd-4d93-4508-a1b3-8180d6a5b753', '109b1281-b049-4641-ae8b-24a960e34d49', 'Active VM', '81105f27-0d06-428d-bedf-308ae0109fb5', 6, 4, 2, False, False) kwargs: {}) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,814::task::304::TaskManager.Task::(run) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::Job.run: running copyImage_a20a37cd-4d93-4508-a1b3-8180d6a5b753: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x7f417c25a290>> (args: ('81105f27-0d06-428d-bedf-308ae0109fb5', '', '611ff093-4634-467b-be1f-e415069ceb71', '3c9b8a70-d380-46c2-857b-beaa9782dc1c', 'a20a37cd-4d93-4508-a1b3-8180d6a5b753', '109b1281-b049-4641-ae8b-24a960e34d49', 'Active VM', '81105f27-0d06-428d-bedf-308ae0109fb5', 6, 4, 2, False, False) kwargs: {}) callback None >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,814::resourceManager::175::ResourceManager.Request::(__init__) ResName=`81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71`ReqID=`b5ab4c16-1497-44f9-9a40-825ad181d412`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,815::resourceManager::486::ResourceManager::(registerResource) Trying to register resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' for lock type 'shared' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,816::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,819::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,823::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:04,827::image::344::Storage.Image::(getChain) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 imgUUID=611ff093-4634-467b-be1f-e415069ceb71 chain=[<storage.fileVolume.FileVolume object at 0x7f417c35bb90>] >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,829::resourceManager::175::ResourceManager.Request::(__init__) ResName=`81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS.3c9b8a70-d380-46c2-857b-beaa9782dc1c`ReqID=`5cef758c-47af-4149-b183-66754053299a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,829::resourceManager::486::ResourceManager::(registerResource) Trying to register resource '81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS.3c9b8a70-d380-46c2-857b-beaa9782dc1c' for lock type 'shared' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,829::resourceManager::528::ResourceManager::(registerResource) Resource '81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS.3c9b8a70-d380-46c2-857b-beaa9782dc1c' is free. Now locking as 'shared' (1 active user) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,830::resourceManager::212::ResourceManager.Request::(grant) ResName=`81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS.3c9b8a70-d380-46c2-857b-beaa9782dc1c`ReqID=`5cef758c-47af-4149-b183-66754053299a`::Granted request >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,830::resourceManager::528::ResourceManager::(registerResource) Resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' is free. Now locking as 'shared' (1 active user) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,830::resourceManager::212::ResourceManager.Request::(grant) ResName=`81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71`ReqID=`b5ab4c16-1497-44f9-9a40-825ad181d412`::Granted request >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,830::resourceManager::175::ResourceManager.Request::(__init__) ResName=`81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.a20a37cd-4d93-4508-a1b3-8180d6a5b753`ReqID=`76f2c7be-9766-4f49-a679-eb95cb3f18f5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,831::resourceManager::486::ResourceManager::(registerResource) Trying to register resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.a20a37cd-4d93-4508-a1b3-8180d6a5b753' for lock type 'exclusive' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,831::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image a20a37cd-4d93-4508-a1b3-8180d6a5b753 does not exist in domain 81105f27-0d06-428d-bedf-308ae0109fb5 >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,832::resourceManager::528::ResourceManager::(registerResource) Resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.a20a37cd-4d93-4508-a1b3-8180d6a5b753' is free. Now locking as 'exclusive' (1 active user) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,832::resourceManager::212::ResourceManager.Request::(grant) ResName=`81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.a20a37cd-4d93-4508-a1b3-8180d6a5b753`ReqID=`76f2c7be-9766-4f49-a679-eb95cb3f18f5`::Granted request >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:04,832::image::775::Storage.Image::(copy) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 vmUUID= srcImgUUID=611ff093-4634-467b-be1f-e415069ceb71 srcVolUUID=3c9b8a70-d380-46c2-857b-beaa9782dc1c dstImgUUID=a20a37cd-4d93-4508-a1b3-8180d6a5b753 dstVolUUID=109b1281-b049-4641-ae8b-24a960e34d49 dstSdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 volType=6 volFormat=COW preallocate=SPARSE force=False postZero=False >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,833::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 3c9b8a70-d380-46c2-857b-beaa9782dc1c >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:04,849::image::820::Storage.Image::(copy) copy source 81105f27-0d06-428d-bedf-308ae0109fb5:611ff093-4634-467b-be1f-e415069ceb71:3c9b8a70-d380-46c2-857b-beaa9782dc1c vol size 4194304 destination 81105f27-0d06-428d-bedf-308ae0109fb5:a20a37cd-4d93-4508-a1b3-8180d6a5b753:109b1281-b049-4641-ae8b-24a960e34d49 apparentsize 512 >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:04,849::image::457::Storage.Image::(isLegal) image a20a37cd-4d93-4508-a1b3-8180d6a5b753 in domain 81105f27-0d06-428d-bedf-308ae0109fb5 has vollist [] >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:04,850::image::119::Storage.Image::(create) Create placeholder /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/a20a37cd-4d93-4508-a1b3-8180d6a5b753 for image's volumes >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,850::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:04,864::volume::457::Storage.Volume::(create) Creating volume 109b1281-b049-4641-ae8b-24a960e34d49 >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,865::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,881::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:04,900::fileVolume::153::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49 with size = 20480 sectors >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,900::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49 10240K' (cwd None) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,910::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,974::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:04,998::fileVolume::401::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=109b1281-b049-4641-ae8b-24a960e34d49 sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5, metaId=('/rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49',) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,021::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,042::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 109b1281-b049-4641-ae8b-24a960e34d49 >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:05,048::volume::707::Storage.Volume::(prepare) Volume: preparing volume 81105f27-0d06-428d-bedf-308ae0109fb5/3c9b8a70-d380-46c2-857b-beaa9782dc1c >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:05,053::volume::707::Storage.Volume::(prepare) Volume: preparing volume 81105f27-0d06-428d-bedf-308ae0109fb5/109b1281-b049-4641-ae8b-24a960e34d49 >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,068::volume::1008::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c (qcow2) to /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49 (qcow2) START >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,069::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c -O qcow2 /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49' (cwd None) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,073::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,583::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = []; <rc> = 0 >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,583::volume::1023::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/611ff093-4634-467b-be1f-e415069ceb71/3c9b8a70-d380-46c2-857b-beaa9782dc1c to /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5/images/a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49 DONE >1f0ca577-c0dc-4891-bda6-c545acf15353::INFO::2012-11-29 13:54:05,590::image::888::Storage.Image::(copy) Finished copying 81105f27-0d06-428d-bedf-308ae0109fb5:3c9b8a70-d380-46c2-857b-beaa9782dc1c -> 81105f27-0d06-428d-bedf-308ae0109fb5:109b1281-b049-4641-ae8b-24a960e34d49 >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,590::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.a20a37cd-4d93-4508-a1b3-8180d6a5b753' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,591::resourceManager::553::ResourceManager::(releaseResource) Released resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.a20a37cd-4d93-4508-a1b3-8180d6a5b753' (0 active users) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,591::resourceManager::558::ResourceManager::(releaseResource) Resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.a20a37cd-4d93-4508-a1b3-8180d6a5b753' is free, finding out if anyone is waiting for it. >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,591::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.a20a37cd-4d93-4508-a1b3-8180d6a5b753', Clearing records. >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,591::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,592::resourceManager::553::ResourceManager::(releaseResource) Released resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' (0 active users) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,592::resourceManager::558::ResourceManager::(releaseResource) Resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71' is free, finding out if anyone is waiting for it. >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,592::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource '81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS.3c9b8a70-d380-46c2-857b-beaa9782dc1c' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,592::resourceManager::553::ResourceManager::(releaseResource) Released resource '81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS.3c9b8a70-d380-46c2-857b-beaa9782dc1c' (0 active users) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,592::resourceManager::558::ResourceManager::(releaseResource) Resource '81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS.3c9b8a70-d380-46c2-857b-beaa9782dc1c' is free, finding out if anyone is waiting for it. >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,593::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource '81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS.3c9b8a70-d380-46c2-857b-beaa9782dc1c', Clearing records. >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,593::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource '81105f27-0d06-428d-bedf-308ae0109fb5_imageNS.611ff093-4634-467b-be1f-e415069ceb71', Clearing records. >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,593::task::568::TaskManager.Task::(_updateState) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::moving from state running -> state finished >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,594::task::719::TaskManager.Task::(_save) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/1f0ca577-c0dc-4891-bda6-c545acf15353.temp >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,619::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,619::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,619::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,620::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,620::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,620::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,620::task::880::TaskManager.Task::(_runJobs) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::Task.run: exit - success: result {'uuid': '109b1281-b049-4641-ae8b-24a960e34d49'} >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,620::task::957::TaskManager.Task::(_decref) Task=`1f0ca577-c0dc-4891-bda6-c545acf15353`::ref 0 aborting False >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:54:05,621::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-146::DEBUG::2012-11-29 13:54:06,156::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-146::DEBUG::2012-11-29 13:54:06,157::task::568::TaskManager.Task::(_updateState) Task=`6a409326-bd8a-405c-91bb-a75957cb599c`::moving from state init -> state preparing >Thread-146::INFO::2012-11-29 13:54:06,157::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-146::INFO::2012-11-29 13:54:06,157::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-146::DEBUG::2012-11-29 13:54:06,158::task::1151::TaskManager.Task::(prepare) Task=`6a409326-bd8a-405c-91bb-a75957cb599c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-146::DEBUG::2012-11-29 13:54:06,158::task::568::TaskManager.Task::(_updateState) Task=`6a409326-bd8a-405c-91bb-a75957cb599c`::moving from state preparing -> state finished >Thread-146::DEBUG::2012-11-29 13:54:06,158::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-146::DEBUG::2012-11-29 13:54:06,158::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::DEBUG::2012-11-29 13:54:06,158::task::957::TaskManager.Task::(_decref) Task=`6a409326-bd8a-405c-91bb-a75957cb599c`::ref 0 aborting False >Thread-147::DEBUG::2012-11-29 13:54:06,178::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-147::DEBUG::2012-11-29 13:54:06,178::task::568::TaskManager.Task::(_updateState) Task=`a95ec3ec-7d63-4527-82c8-176935fcd3b8`::moving from state init -> state preparing >Thread-147::INFO::2012-11-29 13:54:06,178::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-147::DEBUG::2012-11-29 13:54:06,179::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`8275aede-7000-4ae3-880a-2f348a6c493e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-147::DEBUG::2012-11-29 13:54:06,179::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-147::DEBUG::2012-11-29 13:54:06,179::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-147::DEBUG::2012-11-29 13:54:06,179::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`8275aede-7000-4ae3-880a-2f348a6c493e`::Granted request >Thread-147::DEBUG::2012-11-29 13:54:06,180::task::794::TaskManager.Task::(resourceAcquired) Task=`a95ec3ec-7d63-4527-82c8-176935fcd3b8`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-147::DEBUG::2012-11-29 13:54:06,180::task::957::TaskManager.Task::(_decref) Task=`a95ec3ec-7d63-4527-82c8-176935fcd3b8`::ref 1 aborting False >Thread-147::INFO::2012-11-29 13:54:06,183::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859726413824', 'alerts': [], 'disktotal': '859729559552'}}} >Thread-147::DEBUG::2012-11-29 13:54:06,183::task::1151::TaskManager.Task::(prepare) Task=`a95ec3ec-7d63-4527-82c8-176935fcd3b8`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859726413824', 'alerts': [], 'disktotal': '859729559552'}}} >Thread-147::DEBUG::2012-11-29 13:54:06,183::task::568::TaskManager.Task::(_updateState) Task=`a95ec3ec-7d63-4527-82c8-176935fcd3b8`::moving from state preparing -> state finished >Thread-147::DEBUG::2012-11-29 13:54:06,183::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-147::DEBUG::2012-11-29 13:54:06,183::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-147::DEBUG::2012-11-29 13:54:06,184::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-147::DEBUG::2012-11-29 13:54:06,184::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-147::DEBUG::2012-11-29 13:54:06,184::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-147::DEBUG::2012-11-29 13:54:06,184::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-147::DEBUG::2012-11-29 13:54:06,184::task::957::TaskManager.Task::(_decref) Task=`a95ec3ec-7d63-4527-82c8-176935fcd3b8`::ref 0 aborting False >Thread-150::DEBUG::2012-11-29 13:54:11,044::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-150::DEBUG::2012-11-29 13:54:11,044::task::568::TaskManager.Task::(_updateState) Task=`ddc400bc-08b6-4b75-bb08-d57615025d54`::moving from state init -> state preparing >Thread-150::INFO::2012-11-29 13:54:11,045::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-150::DEBUG::2012-11-29 13:54:11,045::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-150::DEBUG::2012-11-29 13:54:11,045::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1f0ca577-c0dc-4891-bda6-c545acf15353 >Thread-150::DEBUG::2012-11-29 13:54:11,045::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1f0ca577-c0dc-4891-bda6-c545acf15353'} >Thread-150::DEBUG::2012-11-29 13:54:11,045::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'1f0ca577-c0dc-4891-bda6-c545acf15353': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1f0ca577-c0dc-4891-bda6-c545acf15353'}} >Thread-150::INFO::2012-11-29 13:54:11,045::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'1f0ca577-c0dc-4891-bda6-c545acf15353': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1f0ca577-c0dc-4891-bda6-c545acf15353'}}} >Thread-150::DEBUG::2012-11-29 13:54:11,046::task::1151::TaskManager.Task::(prepare) Task=`ddc400bc-08b6-4b75-bb08-d57615025d54`::finished: {'allTasksStatus': {'1f0ca577-c0dc-4891-bda6-c545acf15353': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1f0ca577-c0dc-4891-bda6-c545acf15353'}}} >Thread-150::DEBUG::2012-11-29 13:54:11,046::task::568::TaskManager.Task::(_updateState) Task=`ddc400bc-08b6-4b75-bb08-d57615025d54`::moving from state preparing -> state finished >Thread-150::DEBUG::2012-11-29 13:54:11,046::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-150::DEBUG::2012-11-29 13:54:11,046::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-150::DEBUG::2012-11-29 13:54:11,046::task::957::TaskManager.Task::(_decref) Task=`ddc400bc-08b6-4b75-bb08-d57615025d54`::ref 0 aborting False >Thread-152::DEBUG::2012-11-29 13:54:11,094::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-152::DEBUG::2012-11-29 13:54:11,094::task::568::TaskManager.Task::(_updateState) Task=`cad435af-4c1b-499a-9cab-ad5b5d8786d9`::moving from state init -> state preparing >Thread-152::INFO::2012-11-29 13:54:11,094::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', imgUUID='a20a37cd-4d93-4508-a1b3-8180d6a5b753', volUUID='109b1281-b049-4641-ae8b-24a960e34d49', options=None) >Thread-152::DEBUG::2012-11-29 13:54:11,094::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`fc50c69d-d2cf-4cdb-87c3-09d5f52792c7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-152::DEBUG::2012-11-29 13:54:11,095::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-152::DEBUG::2012-11-29 13:54:11,095::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-152::DEBUG::2012-11-29 13:54:11,095::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`fc50c69d-d2cf-4cdb-87c3-09d5f52792c7`::Granted request >Thread-152::DEBUG::2012-11-29 13:54:11,095::task::794::TaskManager.Task::(resourceAcquired) Task=`cad435af-4c1b-499a-9cab-ad5b5d8786d9`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-152::DEBUG::2012-11-29 13:54:11,095::task::957::TaskManager.Task::(_decref) Task=`cad435af-4c1b-499a-9cab-ad5b5d8786d9`::ref 1 aborting False >Thread-152::DEBUG::2012-11-29 13:54:11,097::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 109b1281-b049-4641-ae8b-24a960e34d49 >Thread-152::INFO::2012-11-29 13:54:11,098::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 imgUUID=a20a37cd-4d93-4508-a1b3-8180d6a5b753 volUUID = 109b1281-b049-4641-ae8b-24a960e34d49 >Thread-152::DEBUG::2012-11-29 13:54:11,109::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 109b1281-b049-4641-ae8b-24a960e34d49 >Thread-152::DEBUG::2012-11-29 13:54:11,112::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 109b1281-b049-4641-ae8b-24a960e34d49 >Thread-152::INFO::2012-11-29 13:54:11,114::volume::824::Storage.Volume::(getInfo) 81105f27-0d06-428d-bedf-308ae0109fb5/a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49 info is {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a20a37cd-4d93-4508-a1b3-8180d6a5b753', 'ctime': '1354190044', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190045', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '109b1281-b049-4641-ae8b-24a960e34d49', 'truesize': '512', 'type': 'SPARSE'} >Thread-152::INFO::2012-11-29 13:54:11,115::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a20a37cd-4d93-4508-a1b3-8180d6a5b753', 'ctime': '1354190044', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190045', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '109b1281-b049-4641-ae8b-24a960e34d49', 'truesize': '512', 'type': 'SPARSE'}} >Thread-152::DEBUG::2012-11-29 13:54:11,115::task::1151::TaskManager.Task::(prepare) Task=`cad435af-4c1b-499a-9cab-ad5b5d8786d9`::finished: {'info': {'status': 'OK', 'domain': '81105f27-0d06-428d-bedf-308ae0109fb5', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': 'a20a37cd-4d93-4508-a1b3-8180d6a5b753', 'ctime': '1354190044', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354190045', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '109b1281-b049-4641-ae8b-24a960e34d49', 'truesize': '512', 'type': 'SPARSE'}} >Thread-152::DEBUG::2012-11-29 13:54:11,115::task::568::TaskManager.Task::(_updateState) Task=`cad435af-4c1b-499a-9cab-ad5b5d8786d9`::moving from state preparing -> state finished >Thread-152::DEBUG::2012-11-29 13:54:11,115::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >Thread-152::DEBUG::2012-11-29 13:54:11,115::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-152::DEBUG::2012-11-29 13:54:11,116::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-152::DEBUG::2012-11-29 13:54:11,116::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-152::DEBUG::2012-11-29 13:54:11,116::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-152::DEBUG::2012-11-29 13:54:11,116::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-152::DEBUG::2012-11-29 13:54:11,116::task::957::TaskManager.Task::(_decref) Task=`cad435af-4c1b-499a-9cab-ad5b5d8786d9`::ref 0 aborting False >Thread-153::DEBUG::2012-11-29 13:54:11,169::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-153::DEBUG::2012-11-29 13:54:11,169::task::568::TaskManager.Task::(_updateState) Task=`caaca3df-1513-4bde-bbc9-3163b950d1f0`::moving from state init -> state preparing >Thread-153::INFO::2012-11-29 13:54:11,169::logUtils::37::dispatcher::(wrapper) Run and protect: updateVM(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', vmList=[{'imglist': 'a20a37cd-4d93-4508-a1b3-8180d6a5b753', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.1.0.0"><References><File ovf:href="a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49" ovf:id="109b1281-b049-4641-ae8b-24a960e34d49" ovf:size="2147483648" ovf:description=""/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="109b1281-b049-4641-ae8b-24a960e34d49" ovf:size="2" ovf:actual_size="0" ovf:vm_snapshot_id="bc5270ea-c5ba-4e7f-bac5-c34b83b280cc" ovf:parentRef="" ovf:fileRef="a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="IDE" ovf:boot="false" ovf:disk-alias="restvm_templates_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Name>rest_templ3</Name><TemplateId>f6b0095a-88cc-47b0-8e7a-9b3599013d6a</TemplateId><Description></Description><Domain></Domain><CreationDate>2012/11/29 11:54:04</CreationDate><ExportDate>2012/11/29 11:54:11</ExportDate><IsAutoSuspend>false</IsAutoSuspend><TimeZone></TimeZone><Origin>0</Origin><VmType>0</VmType><default_display_type>1</default_display_type><default_boot_sequence>0</default_boot_sequence><Section ovf:id="f6b0095a-88cc-47b0-8e7a-9b3599013d6a" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>Unassigned</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.1.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>restvm_templates_Disk1</rasd:Caption><rasd:InstanceId>109b1281-b049-4641-ae8b-24a960e34d49</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>a20a37cd-4d93-4508-a1b3-8180d6a5b753/109b1281-b049-4641-ae8b-24a960e34d49</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>81105f27-0d06-428d-bedf-308ae0109fb5</rasd:StorageId><rasd:StoragePoolId>1354c897-ef7d-4edf-aa4c-c1e1464d0e2b</rasd:StoragePoolId><rasd:CreationDate>2012/11/29 11:54:04</rasd:CreationDate><rasd:LastModified>2012/11/29 11:54:05</rasd:LastModified></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>\n', 'vm': 'f6b0095a-88cc-47b0-8e7a-9b3599013d6a'}], sdUUID=None, options=None) >Thread-153::DEBUG::2012-11-29 13:54:11,170::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`91bc80d9-e036-4831-a248-66d1fe7a514d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-153::DEBUG::2012-11-29 13:54:11,170::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-153::DEBUG::2012-11-29 13:54:11,170::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-153::DEBUG::2012-11-29 13:54:11,170::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`91bc80d9-e036-4831-a248-66d1fe7a514d`::Granted request >Thread-153::DEBUG::2012-11-29 13:54:11,170::task::794::TaskManager.Task::(resourceAcquired) Task=`caaca3df-1513-4bde-bbc9-3163b950d1f0`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-153::DEBUG::2012-11-29 13:54:11,171::task::957::TaskManager.Task::(_decref) Task=`caaca3df-1513-4bde-bbc9-3163b950d1f0`::ref 1 aborting False >Thread-153::INFO::2012-11-29 13:54:11,171::sp::1258::Storage.StoragePool::(updateVM) spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-153::INFO::2012-11-29 13:54:11,171::sp::1269::Storage.StoragePool::(updateVM) vmUUID=f6b0095a-88cc-47b0-8e7a-9b3599013d6a imgList=['a20a37cd-4d93-4508-a1b3-8180d6a5b753'] >Thread-153::INFO::2012-11-29 13:54:11,174::logUtils::39::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-153::DEBUG::2012-11-29 13:54:11,174::task::1151::TaskManager.Task::(prepare) Task=`caaca3df-1513-4bde-bbc9-3163b950d1f0`::finished: None >Thread-153::DEBUG::2012-11-29 13:54:11,174::task::568::TaskManager.Task::(_updateState) Task=`caaca3df-1513-4bde-bbc9-3163b950d1f0`::moving from state preparing -> state finished >Thread-153::DEBUG::2012-11-29 13:54:11,174::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-153::DEBUG::2012-11-29 13:54:11,175::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-153::DEBUG::2012-11-29 13:54:11,175::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-153::DEBUG::2012-11-29 13:54:11,175::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-153::DEBUG::2012-11-29 13:54:11,175::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-153::DEBUG::2012-11-29 13:54:11,175::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-153::DEBUG::2012-11-29 13:54:11,176::task::957::TaskManager.Task::(_decref) Task=`caaca3df-1513-4bde-bbc9-3163b950d1f0`::ref 0 aborting False >Thread-154::DEBUG::2012-11-29 13:54:11,215::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-154::DEBUG::2012-11-29 13:54:11,216::task::568::TaskManager.Task::(_updateState) Task=`3e06cadd-4d15-416b-8b35-9de6b7bb393e`::moving from state init -> state preparing >Thread-154::INFO::2012-11-29 13:54:11,216::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='1f0ca577-c0dc-4891-bda6-c545acf15353', spUUID=None, options=None) >Thread-154::DEBUG::2012-11-29 13:54:11,216::taskManager::161::TaskManager::(clearTask) Entry. taskID: 1f0ca577-c0dc-4891-bda6-c545acf15353 >Thread-154::DEBUG::2012-11-29 13:54:11,221::taskManager::166::TaskManager::(clearTask) Return. >Thread-154::INFO::2012-11-29 13:54:11,221::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-154::DEBUG::2012-11-29 13:54:11,222::task::1151::TaskManager.Task::(prepare) Task=`3e06cadd-4d15-416b-8b35-9de6b7bb393e`::finished: None >Thread-154::DEBUG::2012-11-29 13:54:11,222::task::568::TaskManager.Task::(_updateState) Task=`3e06cadd-4d15-416b-8b35-9de6b7bb393e`::moving from state preparing -> state finished >Thread-154::DEBUG::2012-11-29 13:54:11,222::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-154::DEBUG::2012-11-29 13:54:11,222::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-154::DEBUG::2012-11-29 13:54:11,222::task::957::TaskManager.Task::(_decref) Task=`3e06cadd-4d15-416b-8b35-9de6b7bb393e`::ref 0 aborting False >Thread-155::DEBUG::2012-11-29 13:54:13,117::task::568::TaskManager.Task::(_updateState) Task=`85db8f7b-ed3c-4296-a7b7-040345e06b7c`::moving from state init -> state preparing >Thread-155::INFO::2012-11-29 13:54:13,117::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-155::INFO::2012-11-29 13:54:13,117::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00203585624695', 'lastCheck': '7.9', 'code': 0, 'valid': True}} >Thread-155::DEBUG::2012-11-29 13:54:13,117::task::1151::TaskManager.Task::(prepare) Task=`85db8f7b-ed3c-4296-a7b7-040345e06b7c`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00203585624695', 'lastCheck': '7.9', 'code': 0, 'valid': True}} >Thread-155::DEBUG::2012-11-29 13:54:13,117::task::568::TaskManager.Task::(_updateState) Task=`85db8f7b-ed3c-4296-a7b7-040345e06b7c`::moving from state preparing -> state finished >Thread-155::DEBUG::2012-11-29 13:54:13,118::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2012-11-29 13:54:13,118::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2012-11-29 13:54:13,118::task::957::TaskManager.Task::(_decref) Task=`85db8f7b-ed3c-4296-a7b7-040345e06b7c`::ref 0 aborting False >Thread-158::DEBUG::2012-11-29 13:54:16,225::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-158::DEBUG::2012-11-29 13:54:16,226::task::568::TaskManager.Task::(_updateState) Task=`b7d43299-61fc-4a9b-b4b9-47aee53892da`::moving from state init -> state preparing >Thread-158::INFO::2012-11-29 13:54:16,226::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-158::INFO::2012-11-29 13:54:16,226::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-158::DEBUG::2012-11-29 13:54:16,226::task::1151::TaskManager.Task::(prepare) Task=`b7d43299-61fc-4a9b-b4b9-47aee53892da`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-158::DEBUG::2012-11-29 13:54:16,226::task::568::TaskManager.Task::(_updateState) Task=`b7d43299-61fc-4a9b-b4b9-47aee53892da`::moving from state preparing -> state finished >Thread-158::DEBUG::2012-11-29 13:54:16,227::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-158::DEBUG::2012-11-29 13:54:16,227::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-158::DEBUG::2012-11-29 13:54:16,227::task::957::TaskManager.Task::(_decref) Task=`b7d43299-61fc-4a9b-b4b9-47aee53892da`::ref 0 aborting False >Thread-159::DEBUG::2012-11-29 13:54:16,255::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-159::DEBUG::2012-11-29 13:54:16,256::task::568::TaskManager.Task::(_updateState) Task=`f083cc39-3316-43a7-b1f5-77f11ed15421`::moving from state init -> state preparing >Thread-159::INFO::2012-11-29 13:54:16,256::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-159::DEBUG::2012-11-29 13:54:16,256::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`297bc972-7196-4aae-abde-2c0990c93670`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-159::DEBUG::2012-11-29 13:54:16,256::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-159::DEBUG::2012-11-29 13:54:16,257::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-159::DEBUG::2012-11-29 13:54:16,257::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`297bc972-7196-4aae-abde-2c0990c93670`::Granted request >Thread-159::DEBUG::2012-11-29 13:54:16,257::task::794::TaskManager.Task::(resourceAcquired) Task=`f083cc39-3316-43a7-b1f5-77f11ed15421`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-159::DEBUG::2012-11-29 13:54:16,257::task::957::TaskManager.Task::(_decref) Task=`f083cc39-3316-43a7-b1f5-77f11ed15421`::ref 1 aborting False >Thread-159::INFO::2012-11-29 13:54:16,259::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859726413824', 'alerts': [], 'disktotal': '859729559552'}}} >Thread-159::DEBUG::2012-11-29 13:54:16,260::task::1151::TaskManager.Task::(prepare) Task=`f083cc39-3316-43a7-b1f5-77f11ed15421`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859726413824', 'alerts': [], 'disktotal': '859729559552'}}} >Thread-159::DEBUG::2012-11-29 13:54:16,260::task::568::TaskManager.Task::(_updateState) Task=`f083cc39-3316-43a7-b1f5-77f11ed15421`::moving from state preparing -> state finished >Thread-159::DEBUG::2012-11-29 13:54:16,260::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-159::DEBUG::2012-11-29 13:54:16,260::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-159::DEBUG::2012-11-29 13:54:16,260::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-159::DEBUG::2012-11-29 13:54:16,260::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-159::DEBUG::2012-11-29 13:54:16,261::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-159::DEBUG::2012-11-29 13:54:16,261::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-159::DEBUG::2012-11-29 13:54:16,261::task::957::TaskManager.Task::(_decref) Task=`f083cc39-3316-43a7-b1f5-77f11ed15421`::ref 0 aborting False >Thread-163::DEBUG::2012-11-29 13:54:23,334::task::568::TaskManager.Task::(_updateState) Task=`96778e57-660c-462e-8d6b-8517675453a8`::moving from state init -> state preparing >Thread-163::INFO::2012-11-29 13:54:23,334::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-163::INFO::2012-11-29 13:54:23,334::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00215291976929', 'lastCheck': '8.1', 'code': 0, 'valid': True}} >Thread-163::DEBUG::2012-11-29 13:54:23,334::task::1151::TaskManager.Task::(prepare) Task=`96778e57-660c-462e-8d6b-8517675453a8`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00215291976929', 'lastCheck': '8.1', 'code': 0, 'valid': True}} >Thread-163::DEBUG::2012-11-29 13:54:23,335::task::568::TaskManager.Task::(_updateState) Task=`96778e57-660c-462e-8d6b-8517675453a8`::moving from state preparing -> state finished >Thread-163::DEBUG::2012-11-29 13:54:23,335::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-163::DEBUG::2012-11-29 13:54:23,335::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-163::DEBUG::2012-11-29 13:54:23,335::task::957::TaskManager.Task::(_decref) Task=`96778e57-660c-462e-8d6b-8517675453a8`::ref 0 aborting False >Thread-166::DEBUG::2012-11-29 13:54:26,309::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-166::DEBUG::2012-11-29 13:54:26,309::task::568::TaskManager.Task::(_updateState) Task=`dbbe49b2-45e7-4f7e-90b8-23d6e9237975`::moving from state init -> state preparing >Thread-166::INFO::2012-11-29 13:54:26,309::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-166::INFO::2012-11-29 13:54:26,309::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-166::DEBUG::2012-11-29 13:54:26,310::task::1151::TaskManager.Task::(prepare) Task=`dbbe49b2-45e7-4f7e-90b8-23d6e9237975`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-166::DEBUG::2012-11-29 13:54:26,310::task::568::TaskManager.Task::(_updateState) Task=`dbbe49b2-45e7-4f7e-90b8-23d6e9237975`::moving from state preparing -> state finished >Thread-166::DEBUG::2012-11-29 13:54:26,310::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-166::DEBUG::2012-11-29 13:54:26,310::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-166::DEBUG::2012-11-29 13:54:26,310::task::957::TaskManager.Task::(_decref) Task=`dbbe49b2-45e7-4f7e-90b8-23d6e9237975`::ref 0 aborting False >Thread-167::DEBUG::2012-11-29 13:54:26,338::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-167::DEBUG::2012-11-29 13:54:26,338::task::568::TaskManager.Task::(_updateState) Task=`28eb5bf4-0125-44b3-912c-a9b9cc2f15d8`::moving from state init -> state preparing >Thread-167::INFO::2012-11-29 13:54:26,339::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-167::DEBUG::2012-11-29 13:54:26,339::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`4c9e0d36-ecd1-45a3-bee5-44454d953cc8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-167::DEBUG::2012-11-29 13:54:26,339::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-167::DEBUG::2012-11-29 13:54:26,339::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-167::DEBUG::2012-11-29 13:54:26,340::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`4c9e0d36-ecd1-45a3-bee5-44454d953cc8`::Granted request >Thread-167::DEBUG::2012-11-29 13:54:26,340::task::794::TaskManager.Task::(resourceAcquired) Task=`28eb5bf4-0125-44b3-912c-a9b9cc2f15d8`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-167::DEBUG::2012-11-29 13:54:26,340::task::957::TaskManager.Task::(_decref) Task=`28eb5bf4-0125-44b3-912c-a9b9cc2f15d8`::ref 1 aborting False >Thread-167::INFO::2012-11-29 13:54:26,342::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859726413824', 'alerts': [], 'disktotal': '859729559552'}}} >Thread-167::DEBUG::2012-11-29 13:54:26,342::task::1151::TaskManager.Task::(prepare) Task=`28eb5bf4-0125-44b3-912c-a9b9cc2f15d8`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859726413824', 'alerts': [], 'disktotal': '859729559552'}}} >Thread-167::DEBUG::2012-11-29 13:54:26,343::task::568::TaskManager.Task::(_updateState) Task=`28eb5bf4-0125-44b3-912c-a9b9cc2f15d8`::moving from state preparing -> state finished >Thread-167::DEBUG::2012-11-29 13:54:26,343::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-167::DEBUG::2012-11-29 13:54:26,343::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-167::DEBUG::2012-11-29 13:54:26,343::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-167::DEBUG::2012-11-29 13:54:26,343::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-167::DEBUG::2012-11-29 13:54:26,343::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-167::DEBUG::2012-11-29 13:54:26,344::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-167::DEBUG::2012-11-29 13:54:26,344::task::957::TaskManager.Task::(_decref) Task=`28eb5bf4-0125-44b3-912c-a9b9cc2f15d8`::ref 0 aborting False >Thread-171::DEBUG::2012-11-29 13:54:33,565::task::568::TaskManager.Task::(_updateState) Task=`3230b192-ff23-4add-8743-b27a56237338`::moving from state init -> state preparing >Thread-171::INFO::2012-11-29 13:54:33,566::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-171::INFO::2012-11-29 13:54:33,566::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00221300125122', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-171::DEBUG::2012-11-29 13:54:33,566::task::1151::TaskManager.Task::(prepare) Task=`3230b192-ff23-4add-8743-b27a56237338`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00221300125122', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-171::DEBUG::2012-11-29 13:54:33,566::task::568::TaskManager.Task::(_updateState) Task=`3230b192-ff23-4add-8743-b27a56237338`::moving from state preparing -> state finished >Thread-171::DEBUG::2012-11-29 13:54:33,566::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-171::DEBUG::2012-11-29 13:54:33,566::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-171::DEBUG::2012-11-29 13:54:33,567::task::957::TaskManager.Task::(_decref) Task=`3230b192-ff23-4add-8743-b27a56237338`::ref 0 aborting False >Thread-174::DEBUG::2012-11-29 13:54:36,387::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-174::DEBUG::2012-11-29 13:54:36,387::task::568::TaskManager.Task::(_updateState) Task=`2192528e-b97f-4d45-b0e1-05dc2ca4ca95`::moving from state init -> state preparing >Thread-174::INFO::2012-11-29 13:54:36,388::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-174::INFO::2012-11-29 13:54:36,388::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-174::DEBUG::2012-11-29 13:54:36,388::task::1151::TaskManager.Task::(prepare) Task=`2192528e-b97f-4d45-b0e1-05dc2ca4ca95`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-174::DEBUG::2012-11-29 13:54:36,388::task::568::TaskManager.Task::(_updateState) Task=`2192528e-b97f-4d45-b0e1-05dc2ca4ca95`::moving from state preparing -> state finished >Thread-174::DEBUG::2012-11-29 13:54:36,388::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-174::DEBUG::2012-11-29 13:54:36,389::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-174::DEBUG::2012-11-29 13:54:36,389::task::957::TaskManager.Task::(_decref) Task=`2192528e-b97f-4d45-b0e1-05dc2ca4ca95`::ref 0 aborting False >Thread-175::DEBUG::2012-11-29 13:54:36,429::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-175::DEBUG::2012-11-29 13:54:36,429::task::568::TaskManager.Task::(_updateState) Task=`c9d4313c-bcc9-4c15-b9aa-8183abff5da2`::moving from state init -> state preparing >Thread-175::INFO::2012-11-29 13:54:36,430::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-175::DEBUG::2012-11-29 13:54:36,430::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`54b4964d-d2e5-4daa-aa25-17215980f825`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-175::DEBUG::2012-11-29 13:54:36,430::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-175::DEBUG::2012-11-29 13:54:36,430::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-175::DEBUG::2012-11-29 13:54:36,430::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`54b4964d-d2e5-4daa-aa25-17215980f825`::Granted request >Thread-175::DEBUG::2012-11-29 13:54:36,431::task::794::TaskManager.Task::(resourceAcquired) Task=`c9d4313c-bcc9-4c15-b9aa-8183abff5da2`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-175::DEBUG::2012-11-29 13:54:36,431::task::957::TaskManager.Task::(_decref) Task=`c9d4313c-bcc9-4c15-b9aa-8183abff5da2`::ref 1 aborting False >Thread-175::INFO::2012-11-29 13:54:36,433::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859660353536', 'alerts': [], 'disktotal': '859665596416'}}} >Thread-175::DEBUG::2012-11-29 13:54:36,433::task::1151::TaskManager.Task::(prepare) Task=`c9d4313c-bcc9-4c15-b9aa-8183abff5da2`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859660353536', 'alerts': [], 'disktotal': '859665596416'}}} >Thread-175::DEBUG::2012-11-29 13:54:36,433::task::568::TaskManager.Task::(_updateState) Task=`c9d4313c-bcc9-4c15-b9aa-8183abff5da2`::moving from state preparing -> state finished >Thread-175::DEBUG::2012-11-29 13:54:36,434::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-175::DEBUG::2012-11-29 13:54:36,434::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-175::DEBUG::2012-11-29 13:54:36,434::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-175::DEBUG::2012-11-29 13:54:36,434::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-175::DEBUG::2012-11-29 13:54:36,434::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-175::DEBUG::2012-11-29 13:54:36,434::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-175::DEBUG::2012-11-29 13:54:36,435::task::957::TaskManager.Task::(_decref) Task=`c9d4313c-bcc9-4c15-b9aa-8183abff5da2`::ref 0 aborting False >Thread-179::DEBUG::2012-11-29 13:54:43,771::task::568::TaskManager.Task::(_updateState) Task=`aee1c5fa-246c-4170-9a2e-2343fcb96d7f`::moving from state init -> state preparing >Thread-179::INFO::2012-11-29 13:54:43,772::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-179::INFO::2012-11-29 13:54:43,772::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00197196006775', 'lastCheck': '8.5', 'code': 0, 'valid': True}} >Thread-179::DEBUG::2012-11-29 13:54:43,772::task::1151::TaskManager.Task::(prepare) Task=`aee1c5fa-246c-4170-9a2e-2343fcb96d7f`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00197196006775', 'lastCheck': '8.5', 'code': 0, 'valid': True}} >Thread-179::DEBUG::2012-11-29 13:54:43,772::task::568::TaskManager.Task::(_updateState) Task=`aee1c5fa-246c-4170-9a2e-2343fcb96d7f`::moving from state preparing -> state finished >Thread-179::DEBUG::2012-11-29 13:54:43,772::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-179::DEBUG::2012-11-29 13:54:43,773::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-179::DEBUG::2012-11-29 13:54:43,773::task::957::TaskManager.Task::(_decref) Task=`aee1c5fa-246c-4170-9a2e-2343fcb96d7f`::ref 0 aborting False >Thread-182::DEBUG::2012-11-29 13:54:46,482::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-182::DEBUG::2012-11-29 13:54:46,482::task::568::TaskManager.Task::(_updateState) Task=`6e23b1e4-33e4-4902-875a-eab08a4d0246`::moving from state init -> state preparing >Thread-182::INFO::2012-11-29 13:54:46,482::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-182::INFO::2012-11-29 13:54:46,482::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-182::DEBUG::2012-11-29 13:54:46,482::task::1151::TaskManager.Task::(prepare) Task=`6e23b1e4-33e4-4902-875a-eab08a4d0246`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-182::DEBUG::2012-11-29 13:54:46,483::task::568::TaskManager.Task::(_updateState) Task=`6e23b1e4-33e4-4902-875a-eab08a4d0246`::moving from state preparing -> state finished >Thread-182::DEBUG::2012-11-29 13:54:46,483::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-182::DEBUG::2012-11-29 13:54:46,483::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-182::DEBUG::2012-11-29 13:54:46,483::task::957::TaskManager.Task::(_decref) Task=`6e23b1e4-33e4-4902-875a-eab08a4d0246`::ref 0 aborting False >Thread-183::DEBUG::2012-11-29 13:54:46,512::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-183::DEBUG::2012-11-29 13:54:46,512::task::568::TaskManager.Task::(_updateState) Task=`217f40ef-2003-44f3-bb61-fe84d1f0ad14`::moving from state init -> state preparing >Thread-183::INFO::2012-11-29 13:54:46,512::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-183::DEBUG::2012-11-29 13:54:46,513::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`f4770dd7-4352-4a6d-99b2-90d5052a2d74`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-183::DEBUG::2012-11-29 13:54:46,513::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-183::DEBUG::2012-11-29 13:54:46,513::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-183::DEBUG::2012-11-29 13:54:46,513::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`f4770dd7-4352-4a6d-99b2-90d5052a2d74`::Granted request >Thread-183::DEBUG::2012-11-29 13:54:46,514::task::794::TaskManager.Task::(resourceAcquired) Task=`217f40ef-2003-44f3-bb61-fe84d1f0ad14`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-183::DEBUG::2012-11-29 13:54:46,514::task::957::TaskManager.Task::(_decref) Task=`217f40ef-2003-44f3-bb61-fe84d1f0ad14`::ref 1 aborting False >Thread-183::INFO::2012-11-29 13:54:46,516::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859660353536', 'alerts': [], 'disktotal': '859665596416'}}} >Thread-183::DEBUG::2012-11-29 13:54:46,516::task::1151::TaskManager.Task::(prepare) Task=`217f40ef-2003-44f3-bb61-fe84d1f0ad14`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859660353536', 'alerts': [], 'disktotal': '859665596416'}}} >Thread-183::DEBUG::2012-11-29 13:54:46,516::task::568::TaskManager.Task::(_updateState) Task=`217f40ef-2003-44f3-bb61-fe84d1f0ad14`::moving from state preparing -> state finished >Thread-183::DEBUG::2012-11-29 13:54:46,517::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-183::DEBUG::2012-11-29 13:54:46,517::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-183::DEBUG::2012-11-29 13:54:46,517::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-183::DEBUG::2012-11-29 13:54:46,517::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-183::DEBUG::2012-11-29 13:54:46,517::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-183::DEBUG::2012-11-29 13:54:46,517::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-183::DEBUG::2012-11-29 13:54:46,518::task::957::TaskManager.Task::(_decref) Task=`217f40ef-2003-44f3-bb61-fe84d1f0ad14`::ref 0 aborting False >Thread-187::DEBUG::2012-11-29 13:54:53,966::task::568::TaskManager.Task::(_updateState) Task=`475582e1-bb94-4188-b3f3-2f995365471e`::moving from state init -> state preparing >Thread-187::INFO::2012-11-29 13:54:53,966::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-187::INFO::2012-11-29 13:54:53,967::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.0018138885498', 'lastCheck': '8.7', 'code': 0, 'valid': True}} >Thread-187::DEBUG::2012-11-29 13:54:53,967::task::1151::TaskManager.Task::(prepare) Task=`475582e1-bb94-4188-b3f3-2f995365471e`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.0018138885498', 'lastCheck': '8.7', 'code': 0, 'valid': True}} >Thread-187::DEBUG::2012-11-29 13:54:53,967::task::568::TaskManager.Task::(_updateState) Task=`475582e1-bb94-4188-b3f3-2f995365471e`::moving from state preparing -> state finished >Thread-187::DEBUG::2012-11-29 13:54:53,967::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-187::DEBUG::2012-11-29 13:54:53,967::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-187::DEBUG::2012-11-29 13:54:53,967::task::957::TaskManager.Task::(_decref) Task=`475582e1-bb94-4188-b3f3-2f995365471e`::ref 0 aborting False >Thread-190::DEBUG::2012-11-29 13:54:56,563::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-190::DEBUG::2012-11-29 13:54:56,564::task::568::TaskManager.Task::(_updateState) Task=`5624e7c7-9eda-41ae-98f3-7e2a6bec07b5`::moving from state init -> state preparing >Thread-190::INFO::2012-11-29 13:54:56,564::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-190::INFO::2012-11-29 13:54:56,564::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-190::DEBUG::2012-11-29 13:54:56,564::task::1151::TaskManager.Task::(prepare) Task=`5624e7c7-9eda-41ae-98f3-7e2a6bec07b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-190::DEBUG::2012-11-29 13:54:56,564::task::568::TaskManager.Task::(_updateState) Task=`5624e7c7-9eda-41ae-98f3-7e2a6bec07b5`::moving from state preparing -> state finished >Thread-190::DEBUG::2012-11-29 13:54:56,564::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-190::DEBUG::2012-11-29 13:54:56,565::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-190::DEBUG::2012-11-29 13:54:56,565::task::957::TaskManager.Task::(_decref) Task=`5624e7c7-9eda-41ae-98f3-7e2a6bec07b5`::ref 0 aborting False >Thread-191::DEBUG::2012-11-29 13:54:56,593::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-191::DEBUG::2012-11-29 13:54:56,594::task::568::TaskManager.Task::(_updateState) Task=`f52da588-a0d0-4942-b437-54f5b81d4cb3`::moving from state init -> state preparing >Thread-191::INFO::2012-11-29 13:54:56,594::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-191::DEBUG::2012-11-29 13:54:56,594::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`c4b05f61-3491-4217-9ab5-d7abb47cecc5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-191::DEBUG::2012-11-29 13:54:56,594::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-191::DEBUG::2012-11-29 13:54:56,595::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-191::DEBUG::2012-11-29 13:54:56,595::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`c4b05f61-3491-4217-9ab5-d7abb47cecc5`::Granted request >Thread-191::DEBUG::2012-11-29 13:54:56,595::task::794::TaskManager.Task::(resourceAcquired) Task=`f52da588-a0d0-4942-b437-54f5b81d4cb3`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-191::DEBUG::2012-11-29 13:54:56,595::task::957::TaskManager.Task::(_decref) Task=`f52da588-a0d0-4942-b437-54f5b81d4cb3`::ref 1 aborting False >Thread-191::INFO::2012-11-29 13:54:56,597::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859660353536', 'alerts': [], 'disktotal': '859665596416'}}} >Thread-191::DEBUG::2012-11-29 13:54:56,598::task::1151::TaskManager.Task::(prepare) Task=`f52da588-a0d0-4942-b437-54f5b81d4cb3`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859660353536', 'alerts': [], 'disktotal': '859665596416'}}} >Thread-191::DEBUG::2012-11-29 13:54:56,598::task::568::TaskManager.Task::(_updateState) Task=`f52da588-a0d0-4942-b437-54f5b81d4cb3`::moving from state preparing -> state finished >Thread-191::DEBUG::2012-11-29 13:54:56,598::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-191::DEBUG::2012-11-29 13:54:56,598::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-191::DEBUG::2012-11-29 13:54:56,598::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-191::DEBUG::2012-11-29 13:54:56,599::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-191::DEBUG::2012-11-29 13:54:56,599::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-191::DEBUG::2012-11-29 13:54:56,599::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-191::DEBUG::2012-11-29 13:54:56,599::task::957::TaskManager.Task::(_decref) Task=`f52da588-a0d0-4942-b437-54f5b81d4cb3`::ref 0 aborting False >Thread-195::DEBUG::2012-11-29 13:55:04,157::task::568::TaskManager.Task::(_updateState) Task=`8b0a3c0c-317d-4025-a91b-f555cffa1934`::moving from state init -> state preparing >Thread-195::INFO::2012-11-29 13:55:04,157::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-195::INFO::2012-11-29 13:55:04,158::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.0023021697998', 'lastCheck': '8.9', 'code': 0, 'valid': True}} >Thread-195::DEBUG::2012-11-29 13:55:04,158::task::1151::TaskManager.Task::(prepare) Task=`8b0a3c0c-317d-4025-a91b-f555cffa1934`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.0023021697998', 'lastCheck': '8.9', 'code': 0, 'valid': True}} >Thread-195::DEBUG::2012-11-29 13:55:04,158::task::568::TaskManager.Task::(_updateState) Task=`8b0a3c0c-317d-4025-a91b-f555cffa1934`::moving from state preparing -> state finished >Thread-195::DEBUG::2012-11-29 13:55:04,158::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-195::DEBUG::2012-11-29 13:55:04,158::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-195::DEBUG::2012-11-29 13:55:04,158::task::957::TaskManager.Task::(_decref) Task=`8b0a3c0c-317d-4025-a91b-f555cffa1934`::ref 0 aborting False >Thread-198::DEBUG::2012-11-29 13:55:06,637::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-198::DEBUG::2012-11-29 13:55:06,637::task::568::TaskManager.Task::(_updateState) Task=`e8abcff9-7c62-48fc-9d33-ee1a998ac07e`::moving from state init -> state preparing >Thread-198::INFO::2012-11-29 13:55:06,638::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-198::INFO::2012-11-29 13:55:06,638::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-198::DEBUG::2012-11-29 13:55:06,638::task::1151::TaskManager.Task::(prepare) Task=`e8abcff9-7c62-48fc-9d33-ee1a998ac07e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-198::DEBUG::2012-11-29 13:55:06,638::task::568::TaskManager.Task::(_updateState) Task=`e8abcff9-7c62-48fc-9d33-ee1a998ac07e`::moving from state preparing -> state finished >Thread-198::DEBUG::2012-11-29 13:55:06,638::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-198::DEBUG::2012-11-29 13:55:06,639::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-198::DEBUG::2012-11-29 13:55:06,639::task::957::TaskManager.Task::(_decref) Task=`e8abcff9-7c62-48fc-9d33-ee1a998ac07e`::ref 0 aborting False >Thread-199::DEBUG::2012-11-29 13:55:06,666::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-199::DEBUG::2012-11-29 13:55:06,666::task::568::TaskManager.Task::(_updateState) Task=`ee251c8a-6493-4c90-8411-41181e42f9e4`::moving from state init -> state preparing >Thread-199::INFO::2012-11-29 13:55:06,666::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-199::DEBUG::2012-11-29 13:55:06,667::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`b967543b-570a-4b9d-ab37-2e1471483f2a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-199::DEBUG::2012-11-29 13:55:06,667::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-199::DEBUG::2012-11-29 13:55:06,667::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-199::DEBUG::2012-11-29 13:55:06,667::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`b967543b-570a-4b9d-ab37-2e1471483f2a`::Granted request >Thread-199::DEBUG::2012-11-29 13:55:06,668::task::794::TaskManager.Task::(resourceAcquired) Task=`ee251c8a-6493-4c90-8411-41181e42f9e4`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-199::DEBUG::2012-11-29 13:55:06,668::task::957::TaskManager.Task::(_decref) Task=`ee251c8a-6493-4c90-8411-41181e42f9e4`::ref 1 aborting False >Thread-199::INFO::2012-11-29 13:55:06,670::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859478949888', 'alerts': [], 'disktotal': '859484192768'}}} >Thread-199::DEBUG::2012-11-29 13:55:06,670::task::1151::TaskManager.Task::(prepare) Task=`ee251c8a-6493-4c90-8411-41181e42f9e4`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859478949888', 'alerts': [], 'disktotal': '859484192768'}}} >Thread-199::DEBUG::2012-11-29 13:55:06,670::task::568::TaskManager.Task::(_updateState) Task=`ee251c8a-6493-4c90-8411-41181e42f9e4`::moving from state preparing -> state finished >Thread-199::DEBUG::2012-11-29 13:55:06,671::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-199::DEBUG::2012-11-29 13:55:06,671::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-199::DEBUG::2012-11-29 13:55:06,671::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-199::DEBUG::2012-11-29 13:55:06,671::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-199::DEBUG::2012-11-29 13:55:06,671::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-199::DEBUG::2012-11-29 13:55:06,671::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-199::DEBUG::2012-11-29 13:55:06,672::task::957::TaskManager.Task::(_decref) Task=`ee251c8a-6493-4c90-8411-41181e42f9e4`::ref 0 aborting False >Thread-203::DEBUG::2012-11-29 13:55:14,361::task::568::TaskManager.Task::(_updateState) Task=`e0353375-b0fe-49f3-a421-13164b3270c1`::moving from state init -> state preparing >Thread-203::INFO::2012-11-29 13:55:14,361::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-203::INFO::2012-11-29 13:55:14,362::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00268507003784', 'lastCheck': '9.1', 'code': 0, 'valid': True}} >Thread-203::DEBUG::2012-11-29 13:55:14,362::task::1151::TaskManager.Task::(prepare) Task=`e0353375-b0fe-49f3-a421-13164b3270c1`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00268507003784', 'lastCheck': '9.1', 'code': 0, 'valid': True}} >Thread-203::DEBUG::2012-11-29 13:55:14,362::task::568::TaskManager.Task::(_updateState) Task=`e0353375-b0fe-49f3-a421-13164b3270c1`::moving from state preparing -> state finished >Thread-203::DEBUG::2012-11-29 13:55:14,362::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-203::DEBUG::2012-11-29 13:55:14,362::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-203::DEBUG::2012-11-29 13:55:14,362::task::957::TaskManager.Task::(_decref) Task=`e0353375-b0fe-49f3-a421-13164b3270c1`::ref 0 aborting False >Thread-206::DEBUG::2012-11-29 13:55:16,715::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-206::DEBUG::2012-11-29 13:55:16,720::task::568::TaskManager.Task::(_updateState) Task=`cfe86da8-f305-4ad5-869e-e0cbee7fe3ef`::moving from state init -> state preparing >Thread-206::INFO::2012-11-29 13:55:16,720::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-206::INFO::2012-11-29 13:55:16,720::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-206::DEBUG::2012-11-29 13:55:16,720::task::1151::TaskManager.Task::(prepare) Task=`cfe86da8-f305-4ad5-869e-e0cbee7fe3ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-206::DEBUG::2012-11-29 13:55:16,721::task::568::TaskManager.Task::(_updateState) Task=`cfe86da8-f305-4ad5-869e-e0cbee7fe3ef`::moving from state preparing -> state finished >Thread-206::DEBUG::2012-11-29 13:55:16,721::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-206::DEBUG::2012-11-29 13:55:16,721::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-206::DEBUG::2012-11-29 13:55:16,721::task::957::TaskManager.Task::(_decref) Task=`cfe86da8-f305-4ad5-869e-e0cbee7fe3ef`::ref 0 aborting False >Thread-207::DEBUG::2012-11-29 13:55:16,749::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-207::DEBUG::2012-11-29 13:55:16,750::task::568::TaskManager.Task::(_updateState) Task=`6da80729-333f-4d40-b720-f3bba5c98dc1`::moving from state init -> state preparing >Thread-207::INFO::2012-11-29 13:55:16,750::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-207::DEBUG::2012-11-29 13:55:16,750::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`ebaeb645-9615-45f1-9a6b-e2b7b75bf3b3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-207::DEBUG::2012-11-29 13:55:16,751::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-207::DEBUG::2012-11-29 13:55:16,751::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-207::DEBUG::2012-11-29 13:55:16,751::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`ebaeb645-9615-45f1-9a6b-e2b7b75bf3b3`::Granted request >Thread-207::DEBUG::2012-11-29 13:55:16,752::task::794::TaskManager.Task::(resourceAcquired) Task=`6da80729-333f-4d40-b720-f3bba5c98dc1`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-207::DEBUG::2012-11-29 13:55:16,752::task::957::TaskManager.Task::(_decref) Task=`6da80729-333f-4d40-b720-f3bba5c98dc1`::ref 1 aborting False >Thread-207::INFO::2012-11-29 13:55:16,756::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859478949888', 'alerts': [], 'disktotal': '859484192768'}}} >Thread-207::DEBUG::2012-11-29 13:55:16,756::task::1151::TaskManager.Task::(prepare) Task=`6da80729-333f-4d40-b720-f3bba5c98dc1`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859478949888', 'alerts': [], 'disktotal': '859484192768'}}} >Thread-207::DEBUG::2012-11-29 13:55:16,756::task::568::TaskManager.Task::(_updateState) Task=`6da80729-333f-4d40-b720-f3bba5c98dc1`::moving from state preparing -> state finished >Thread-207::DEBUG::2012-11-29 13:55:16,757::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-207::DEBUG::2012-11-29 13:55:16,757::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-207::DEBUG::2012-11-29 13:55:16,757::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-207::DEBUG::2012-11-29 13:55:16,758::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-207::DEBUG::2012-11-29 13:55:16,758::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-207::DEBUG::2012-11-29 13:55:16,758::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-207::DEBUG::2012-11-29 13:55:16,759::task::957::TaskManager.Task::(_decref) Task=`6da80729-333f-4d40-b720-f3bba5c98dc1`::ref 0 aborting False >Thread-211::DEBUG::2012-11-29 13:55:24,639::task::568::TaskManager.Task::(_updateState) Task=`2e64d433-535d-4851-a6f7-5e1a62ffce96`::moving from state init -> state preparing >Thread-211::INFO::2012-11-29 13:55:24,640::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-211::INFO::2012-11-29 13:55:24,640::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00192713737488', 'lastCheck': '9.3', 'code': 0, 'valid': True}} >Thread-211::DEBUG::2012-11-29 13:55:24,640::task::1151::TaskManager.Task::(prepare) Task=`2e64d433-535d-4851-a6f7-5e1a62ffce96`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00192713737488', 'lastCheck': '9.3', 'code': 0, 'valid': True}} >Thread-211::DEBUG::2012-11-29 13:55:24,640::task::568::TaskManager.Task::(_updateState) Task=`2e64d433-535d-4851-a6f7-5e1a62ffce96`::moving from state preparing -> state finished >Thread-211::DEBUG::2012-11-29 13:55:24,640::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-211::DEBUG::2012-11-29 13:55:24,640::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-211::DEBUG::2012-11-29 13:55:24,641::task::957::TaskManager.Task::(_decref) Task=`2e64d433-535d-4851-a6f7-5e1a62ffce96`::ref 0 aborting False >Thread-214::DEBUG::2012-11-29 13:55:26,799::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-214::DEBUG::2012-11-29 13:55:26,799::task::568::TaskManager.Task::(_updateState) Task=`066c828e-a403-4ae6-8442-cb7b7382e85d`::moving from state init -> state preparing >Thread-214::INFO::2012-11-29 13:55:26,800::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-214::INFO::2012-11-29 13:55:26,800::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-214::DEBUG::2012-11-29 13:55:26,800::task::1151::TaskManager.Task::(prepare) Task=`066c828e-a403-4ae6-8442-cb7b7382e85d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-214::DEBUG::2012-11-29 13:55:26,800::task::568::TaskManager.Task::(_updateState) Task=`066c828e-a403-4ae6-8442-cb7b7382e85d`::moving from state preparing -> state finished >Thread-214::DEBUG::2012-11-29 13:55:26,800::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-214::DEBUG::2012-11-29 13:55:26,800::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-214::DEBUG::2012-11-29 13:55:26,801::task::957::TaskManager.Task::(_decref) Task=`066c828e-a403-4ae6-8442-cb7b7382e85d`::ref 0 aborting False >Thread-215::DEBUG::2012-11-29 13:55:26,822::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-215::DEBUG::2012-11-29 13:55:26,823::task::568::TaskManager.Task::(_updateState) Task=`ce605e13-579f-4d11-99e8-27b7de1a19a2`::moving from state init -> state preparing >Thread-215::INFO::2012-11-29 13:55:26,823::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-215::DEBUG::2012-11-29 13:55:26,824::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`600dd458-9f2a-47d7-b7d1-676444b055da`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-215::DEBUG::2012-11-29 13:55:26,824::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-215::DEBUG::2012-11-29 13:55:26,824::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-215::DEBUG::2012-11-29 13:55:26,824::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`600dd458-9f2a-47d7-b7d1-676444b055da`::Granted request >Thread-215::DEBUG::2012-11-29 13:55:26,825::task::794::TaskManager.Task::(resourceAcquired) Task=`ce605e13-579f-4d11-99e8-27b7de1a19a2`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-215::DEBUG::2012-11-29 13:55:26,825::task::957::TaskManager.Task::(_decref) Task=`ce605e13-579f-4d11-99e8-27b7de1a19a2`::ref 1 aborting False >Thread-215::INFO::2012-11-29 13:55:26,828::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859478949888', 'alerts': [], 'disktotal': '859484192768'}}} >Thread-215::DEBUG::2012-11-29 13:55:26,829::task::1151::TaskManager.Task::(prepare) Task=`ce605e13-579f-4d11-99e8-27b7de1a19a2`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859478949888', 'alerts': [], 'disktotal': '859484192768'}}} >Thread-215::DEBUG::2012-11-29 13:55:26,829::task::568::TaskManager.Task::(_updateState) Task=`ce605e13-579f-4d11-99e8-27b7de1a19a2`::moving from state preparing -> state finished >Thread-215::DEBUG::2012-11-29 13:55:26,829::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-215::DEBUG::2012-11-29 13:55:26,829::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-215::DEBUG::2012-11-29 13:55:26,829::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-215::DEBUG::2012-11-29 13:55:26,830::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-215::DEBUG::2012-11-29 13:55:26,830::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-215::DEBUG::2012-11-29 13:55:26,830::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-215::DEBUG::2012-11-29 13:55:26,830::task::957::TaskManager.Task::(_decref) Task=`ce605e13-579f-4d11-99e8-27b7de1a19a2`::ref 0 aborting False >Thread-219::DEBUG::2012-11-29 13:55:34,863::task::568::TaskManager.Task::(_updateState) Task=`2c2d4849-1cad-4e74-afaa-d54ee6aa0fb4`::moving from state init -> state preparing >Thread-219::INFO::2012-11-29 13:55:34,863::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-219::INFO::2012-11-29 13:55:34,863::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00218605995178', 'lastCheck': '9.6', 'code': 0, 'valid': True}} >Thread-219::DEBUG::2012-11-29 13:55:34,864::task::1151::TaskManager.Task::(prepare) Task=`2c2d4849-1cad-4e74-afaa-d54ee6aa0fb4`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00218605995178', 'lastCheck': '9.6', 'code': 0, 'valid': True}} >Thread-219::DEBUG::2012-11-29 13:55:34,864::task::568::TaskManager.Task::(_updateState) Task=`2c2d4849-1cad-4e74-afaa-d54ee6aa0fb4`::moving from state preparing -> state finished >Thread-219::DEBUG::2012-11-29 13:55:34,864::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-219::DEBUG::2012-11-29 13:55:34,864::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-219::DEBUG::2012-11-29 13:55:34,864::task::957::TaskManager.Task::(_decref) Task=`2c2d4849-1cad-4e74-afaa-d54ee6aa0fb4`::ref 0 aborting False >Thread-221::DEBUG::2012-11-29 13:55:36,351::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-221::DEBUG::2012-11-29 13:55:36,352::task::568::TaskManager.Task::(_updateState) Task=`1502e079-3f6b-48a8-bb0d-1c0e304616fc`::moving from state init -> state preparing >Thread-221::INFO::2012-11-29 13:55:36,352::logUtils::37::dispatcher::(wrapper) Run and protect: removeVM(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', vmUUID='0a127e3d-d5f5-4baa-83dd-05135dcbc6d9', sdUUID=None, options=None) >Thread-221::DEBUG::2012-11-29 13:55:36,352::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`50662795-df03-4500-817c-94a58dc113d6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-221::DEBUG::2012-11-29 13:55:36,352::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-221::DEBUG::2012-11-29 13:55:36,353::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-221::DEBUG::2012-11-29 13:55:36,353::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`50662795-df03-4500-817c-94a58dc113d6`::Granted request >Thread-221::DEBUG::2012-11-29 13:55:36,353::task::794::TaskManager.Task::(resourceAcquired) Task=`1502e079-3f6b-48a8-bb0d-1c0e304616fc`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-221::DEBUG::2012-11-29 13:55:36,353::task::957::TaskManager.Task::(_decref) Task=`1502e079-3f6b-48a8-bb0d-1c0e304616fc`::ref 1 aborting False >Thread-221::INFO::2012-11-29 13:55:36,354::sp::1296::Storage.StoragePool::(removeVM) spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b vmUUID=0a127e3d-d5f5-4baa-83dd-05135dcbc6d9 sdUUID=None >Thread-221::INFO::2012-11-29 13:55:36,354::logUtils::39::dispatcher::(wrapper) Run and protect: removeVM, Return response: None >Thread-221::DEBUG::2012-11-29 13:55:36,354::task::1151::TaskManager.Task::(prepare) Task=`1502e079-3f6b-48a8-bb0d-1c0e304616fc`::finished: None >Thread-221::DEBUG::2012-11-29 13:55:36,354::task::568::TaskManager.Task::(_updateState) Task=`1502e079-3f6b-48a8-bb0d-1c0e304616fc`::moving from state preparing -> state finished >Thread-221::DEBUG::2012-11-29 13:55:36,354::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-221::DEBUG::2012-11-29 13:55:36,355::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221::DEBUG::2012-11-29 13:55:36,355::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-221::DEBUG::2012-11-29 13:55:36,355::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-221::DEBUG::2012-11-29 13:55:36,355::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-221::DEBUG::2012-11-29 13:55:36,355::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-221::DEBUG::2012-11-29 13:55:36,356::task::957::TaskManager.Task::(_decref) Task=`1502e079-3f6b-48a8-bb0d-1c0e304616fc`::ref 0 aborting False >Thread-222::DEBUG::2012-11-29 13:55:36,433::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-222::DEBUG::2012-11-29 13:55:36,433::task::568::TaskManager.Task::(_updateState) Task=`12908d01-db3a-4913-9528-ca241d77195c`::moving from state init -> state preparing >Thread-222::INFO::2012-11-29 13:55:36,433::logUtils::37::dispatcher::(wrapper) Run and protect: removeVM(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', vmUUID='526eb6ec-81a2-4981-b316-6fa5dd072dee', sdUUID=None, options=None) >Thread-222::DEBUG::2012-11-29 13:55:36,434::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`e64be459-e4fd-401e-a9e9-4a92c3477c1f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-222::DEBUG::2012-11-29 13:55:36,434::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-222::DEBUG::2012-11-29 13:55:36,434::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-222::DEBUG::2012-11-29 13:55:36,434::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`e64be459-e4fd-401e-a9e9-4a92c3477c1f`::Granted request >Thread-222::DEBUG::2012-11-29 13:55:36,435::task::794::TaskManager.Task::(resourceAcquired) Task=`12908d01-db3a-4913-9528-ca241d77195c`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-222::DEBUG::2012-11-29 13:55:36,435::task::957::TaskManager.Task::(_decref) Task=`12908d01-db3a-4913-9528-ca241d77195c`::ref 1 aborting False >Thread-222::INFO::2012-11-29 13:55:36,435::sp::1296::Storage.StoragePool::(removeVM) spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b vmUUID=526eb6ec-81a2-4981-b316-6fa5dd072dee sdUUID=None >Thread-222::INFO::2012-11-29 13:55:36,437::logUtils::39::dispatcher::(wrapper) Run and protect: removeVM, Return response: None >Thread-222::DEBUG::2012-11-29 13:55:36,437::task::1151::TaskManager.Task::(prepare) Task=`12908d01-db3a-4913-9528-ca241d77195c`::finished: None >Thread-222::DEBUG::2012-11-29 13:55:36,437::task::568::TaskManager.Task::(_updateState) Task=`12908d01-db3a-4913-9528-ca241d77195c`::moving from state preparing -> state finished >Thread-222::DEBUG::2012-11-29 13:55:36,438::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-222::DEBUG::2012-11-29 13:55:36,438::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-222::DEBUG::2012-11-29 13:55:36,438::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-222::DEBUG::2012-11-29 13:55:36,438::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-222::DEBUG::2012-11-29 13:55:36,438::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-222::DEBUG::2012-11-29 13:55:36,439::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-222::DEBUG::2012-11-29 13:55:36,439::task::957::TaskManager.Task::(_decref) Task=`12908d01-db3a-4913-9528-ca241d77195c`::ref 0 aborting False >Thread-223::DEBUG::2012-11-29 13:55:36,494::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-223::DEBUG::2012-11-29 13:55:36,494::task::568::TaskManager.Task::(_updateState) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::moving from state init -> state preparing >Thread-223::INFO::2012-11-29 13:55:36,494::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', imgUUID='611ff093-4634-467b-be1f-e415069ceb71', postZero='false', force='false') >Thread-223::INFO::2012-11-29 13:55:36,494::fileSD::302::Storage.StorageDomain::(validate) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-223::DEBUG::2012-11-29 13:55:36,497::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9ac9b8816517dc36c03957538bcd105774acb179'] >Thread-223::DEBUG::2012-11-29 13:55:36,497::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.611ff093-4634-467b-be1f-e415069ceb71`ReqID=`d7c88773-fe1b-4d6b-8651-066b866529ce`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-223::DEBUG::2012-11-29 13:55:36,498::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.611ff093-4634-467b-be1f-e415069ceb71' for lock type 'exclusive' >Thread-223::DEBUG::2012-11-29 13:55:36,498::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.611ff093-4634-467b-be1f-e415069ceb71' is free. Now locking as 'exclusive' (1 active user) >Thread-223::DEBUG::2012-11-29 13:55:36,498::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.611ff093-4634-467b-be1f-e415069ceb71`ReqID=`d7c88773-fe1b-4d6b-8651-066b866529ce`::Granted request >Thread-223::DEBUG::2012-11-29 13:55:36,499::task::794::TaskManager.Task::(resourceAcquired) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::_resourcesAcquired: Storage.611ff093-4634-467b-be1f-e415069ceb71 (exclusive) >Thread-223::DEBUG::2012-11-29 13:55:36,499::task::957::TaskManager.Task::(_decref) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::ref 1 aborting False >Thread-223::DEBUG::2012-11-29 13:55:36,499::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`32e8c123-52b6-4b4c-b480-62a39c72d4b5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-223::DEBUG::2012-11-29 13:55:36,500::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-223::DEBUG::2012-11-29 13:55:36,500::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-223::DEBUG::2012-11-29 13:55:36,500::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`32e8c123-52b6-4b4c-b480-62a39c72d4b5`::Granted request >Thread-223::DEBUG::2012-11-29 13:55:36,500::task::794::TaskManager.Task::(resourceAcquired) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-223::DEBUG::2012-11-29 13:55:36,500::task::957::TaskManager.Task::(_decref) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::ref 1 aborting False >Thread-223::DEBUG::2012-11-29 13:55:36,523::task::719::TaskManager.Task::(_save) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749.temp >Thread-223::DEBUG::2012-11-29 13:55:36,532::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_611ff093-4634-467b-be1f-e415069ceb71 for task b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 >Thread-223::INFO::2012-11-29 13:55:36,532::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-223::DEBUG::2012-11-29 13:55:36,532::task::1146::TaskManager.Task::(prepare) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::Prepare: 1 jobs exist, move to acquiring >Thread-223::DEBUG::2012-11-29 13:55:36,532::task::568::TaskManager.Task::(_updateState) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::moving from state preparing -> state acquiring >Thread-223::DEBUG::2012-11-29 13:55:36,533::task::719::TaskManager.Task::(_save) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749.temp >Thread-223::DEBUG::2012-11-29 13:55:36,544::task::568::TaskManager.Task::(_updateState) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::moving from state acquiring -> state queued >Thread-223::DEBUG::2012-11-29 13:55:36,545::task::719::TaskManager.Task::(_save) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749.temp >Thread-223::DEBUG::2012-11-29 13:55:36,557::taskManager::50::TaskManager::(_queueTask) queuing task: b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 >Thread-223::DEBUG::2012-11-29 13:55:36,557::taskManager::56::TaskManager::(_queueTask) task queued: b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 >Thread-2::DEBUG::2012-11-29 13:55:36,557::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-223::DEBUG::2012-11-29 13:55:36,557::task::1148::TaskManager.Task::(prepare) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::returning >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,557::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 running: <bound method Task.commit of <storage.task.Task instance at 0x7f417c364cb0>> with: None >Thread-223::DEBUG::2012-11-29 13:55:36,558::task::957::TaskManager.Task::(_decref) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::ref 0 aborting False >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,558::task::1159::TaskManager.Task::(commit) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::committing task: b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,558::task::568::TaskManager.Task::(_updateState) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::moving from state queued -> state running >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,559::task::719::TaskManager.Task::(_save) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749.temp >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,570::task::872::TaskManager.Task::(_runJobs) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::Task.run: running job 0: deleteImage_611ff093-4634-467b-be1f-e415069ceb71: <function <lambda> at 0x7f417c383e60> (args: () kwargs: {}) >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,570::task::304::TaskManager.Task::(run) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::Job.run: running deleteImage_611ff093-4634-467b-be1f-e415069ceb71: <function <lambda> at 0x7f417c383e60> (args: () kwargs: {}) callback None >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,570::task::568::TaskManager.Task::(_updateState) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::moving from state running -> state finished >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,571::task::719::TaskManager.Task::(_save) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/b8ebf1dc-ed34-475e-b3fe-a7934a8a6749.temp >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,584::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.611ff093-4634-467b-be1f-e415069ceb71': < ResourceRef 'Storage.611ff093-4634-467b-be1f-e415069ceb71', isValid: 'True' obj: 'None'>, 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,584::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,584::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.611ff093-4634-467b-be1f-e415069ceb71' >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,585::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.611ff093-4634-467b-be1f-e415069ceb71' (0 active users) >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,585::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.611ff093-4634-467b-be1f-e415069ceb71' is free, finding out if anyone is waiting for it. >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,585::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.611ff093-4634-467b-be1f-e415069ceb71', Clearing records. >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,585::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,585::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,585::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,586::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,586::task::880::TaskManager.Task::(_runJobs) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::Task.run: exit - success: result True >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,586::task::957::TaskManager.Task::(_decref) Task=`b8ebf1dc-ed34-475e-b3fe-a7934a8a6749`::ref 0 aborting False >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:36,586::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-224::DEBUG::2012-11-29 13:55:36,871::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-224::DEBUG::2012-11-29 13:55:36,872::task::568::TaskManager.Task::(_updateState) Task=`a475cba4-0b2d-4ac2-9d1b-0d00c6cf693d`::moving from state init -> state preparing >Thread-224::INFO::2012-11-29 13:55:36,872::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-224::INFO::2012-11-29 13:55:36,872::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-224::DEBUG::2012-11-29 13:55:36,872::task::1151::TaskManager.Task::(prepare) Task=`a475cba4-0b2d-4ac2-9d1b-0d00c6cf693d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-224::DEBUG::2012-11-29 13:55:36,872::task::568::TaskManager.Task::(_updateState) Task=`a475cba4-0b2d-4ac2-9d1b-0d00c6cf693d`::moving from state preparing -> state finished >Thread-224::DEBUG::2012-11-29 13:55:36,873::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-224::DEBUG::2012-11-29 13:55:36,873::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-224::DEBUG::2012-11-29 13:55:36,873::task::957::TaskManager.Task::(_decref) Task=`a475cba4-0b2d-4ac2-9d1b-0d00c6cf693d`::ref 0 aborting False >Thread-225::DEBUG::2012-11-29 13:55:36,899::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-225::DEBUG::2012-11-29 13:55:36,899::task::568::TaskManager.Task::(_updateState) Task=`0774ee39-fcc9-476e-a420-01c6bb25ef79`::moving from state init -> state preparing >Thread-225::INFO::2012-11-29 13:55:36,899::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-225::DEBUG::2012-11-29 13:55:36,899::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`497e217b-ec0f-4011-bc26-9e81368af1c3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-225::DEBUG::2012-11-29 13:55:36,900::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-225::DEBUG::2012-11-29 13:55:36,900::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-225::DEBUG::2012-11-29 13:55:36,900::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`497e217b-ec0f-4011-bc26-9e81368af1c3`::Granted request >Thread-225::DEBUG::2012-11-29 13:55:36,900::task::794::TaskManager.Task::(resourceAcquired) Task=`0774ee39-fcc9-476e-a420-01c6bb25ef79`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-225::DEBUG::2012-11-29 13:55:36,900::task::957::TaskManager.Task::(_decref) Task=`0774ee39-fcc9-476e-a420-01c6bb25ef79`::ref 1 aborting False >Thread-225::INFO::2012-11-29 13:55:36,903::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859383529472', 'alerts': [], 'disktotal': '859388772352'}}} >Thread-225::DEBUG::2012-11-29 13:55:36,903::task::1151::TaskManager.Task::(prepare) Task=`0774ee39-fcc9-476e-a420-01c6bb25ef79`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859383529472', 'alerts': [], 'disktotal': '859388772352'}}} >Thread-225::DEBUG::2012-11-29 13:55:36,903::task::568::TaskManager.Task::(_updateState) Task=`0774ee39-fcc9-476e-a420-01c6bb25ef79`::moving from state preparing -> state finished >Thread-225::DEBUG::2012-11-29 13:55:36,903::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-225::DEBUG::2012-11-29 13:55:36,903::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-225::DEBUG::2012-11-29 13:55:36,903::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-225::DEBUG::2012-11-29 13:55:36,904::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-225::DEBUG::2012-11-29 13:55:36,904::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-225::DEBUG::2012-11-29 13:55:36,904::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-225::DEBUG::2012-11-29 13:55:36,904::task::957::TaskManager.Task::(_decref) Task=`0774ee39-fcc9-476e-a420-01c6bb25ef79`::ref 0 aborting False >Thread-229::DEBUG::2012-11-29 13:55:41,090::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-229::DEBUG::2012-11-29 13:55:41,091::task::568::TaskManager.Task::(_updateState) Task=`09f2bd9e-ee1f-496a-9e7f-d518d3d4ede9`::moving from state init -> state preparing >Thread-229::INFO::2012-11-29 13:55:41,091::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-229::DEBUG::2012-11-29 13:55:41,091::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-229::DEBUG::2012-11-29 13:55:41,091::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 >Thread-229::DEBUG::2012-11-29 13:55:41,091::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'b8ebf1dc-ed34-475e-b3fe-a7934a8a6749'} >Thread-229::DEBUG::2012-11-29 13:55:41,092::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'b8ebf1dc-ed34-475e-b3fe-a7934a8a6749': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'b8ebf1dc-ed34-475e-b3fe-a7934a8a6749'}} >Thread-229::INFO::2012-11-29 13:55:41,092::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'b8ebf1dc-ed34-475e-b3fe-a7934a8a6749': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'b8ebf1dc-ed34-475e-b3fe-a7934a8a6749'}}} >Thread-229::DEBUG::2012-11-29 13:55:41,092::task::1151::TaskManager.Task::(prepare) Task=`09f2bd9e-ee1f-496a-9e7f-d518d3d4ede9`::finished: {'allTasksStatus': {'b8ebf1dc-ed34-475e-b3fe-a7934a8a6749': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'b8ebf1dc-ed34-475e-b3fe-a7934a8a6749'}}} >Thread-229::DEBUG::2012-11-29 13:55:41,092::task::568::TaskManager.Task::(_updateState) Task=`09f2bd9e-ee1f-496a-9e7f-d518d3d4ede9`::moving from state preparing -> state finished >Thread-229::DEBUG::2012-11-29 13:55:41,092::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-229::DEBUG::2012-11-29 13:55:41,092::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-229::DEBUG::2012-11-29 13:55:41,093::task::957::TaskManager.Task::(_decref) Task=`09f2bd9e-ee1f-496a-9e7f-d518d3d4ede9`::ref 0 aborting False >Thread-230::DEBUG::2012-11-29 13:55:41,170::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-230::DEBUG::2012-11-29 13:55:41,170::task::568::TaskManager.Task::(_updateState) Task=`ed04f4b9-c953-46ce-a6ed-27ab39e3bdb1`::moving from state init -> state preparing >Thread-230::INFO::2012-11-29 13:55:41,170::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='b8ebf1dc-ed34-475e-b3fe-a7934a8a6749', spUUID=None, options=None) >Thread-230::DEBUG::2012-11-29 13:55:41,171::taskManager::161::TaskManager::(clearTask) Entry. taskID: b8ebf1dc-ed34-475e-b3fe-a7934a8a6749 >Thread-230::DEBUG::2012-11-29 13:55:41,175::taskManager::166::TaskManager::(clearTask) Return. >Thread-230::INFO::2012-11-29 13:55:41,175::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-230::DEBUG::2012-11-29 13:55:41,175::task::1151::TaskManager.Task::(prepare) Task=`ed04f4b9-c953-46ce-a6ed-27ab39e3bdb1`::finished: None >Thread-230::DEBUG::2012-11-29 13:55:41,175::task::568::TaskManager.Task::(_updateState) Task=`ed04f4b9-c953-46ce-a6ed-27ab39e3bdb1`::moving from state preparing -> state finished >Thread-230::DEBUG::2012-11-29 13:55:41,175::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-230::DEBUG::2012-11-29 13:55:41,175::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-230::DEBUG::2012-11-29 13:55:41,176::task::957::TaskManager.Task::(_decref) Task=`ed04f4b9-c953-46ce-a6ed-27ab39e3bdb1`::ref 0 aborting False >Thread-232::DEBUG::2012-11-29 13:55:45,101::task::568::TaskManager.Task::(_updateState) Task=`d441e1f1-dfff-4eba-9aee-a826fc233a6c`::moving from state init -> state preparing >Thread-232::INFO::2012-11-29 13:55:45,101::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-232::INFO::2012-11-29 13:55:45,101::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00225687026978', 'lastCheck': '9.8', 'code': 0, 'valid': True}} >Thread-232::DEBUG::2012-11-29 13:55:45,101::task::1151::TaskManager.Task::(prepare) Task=`d441e1f1-dfff-4eba-9aee-a826fc233a6c`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00225687026978', 'lastCheck': '9.8', 'code': 0, 'valid': True}} >Thread-232::DEBUG::2012-11-29 13:55:45,102::task::568::TaskManager.Task::(_updateState) Task=`d441e1f1-dfff-4eba-9aee-a826fc233a6c`::moving from state preparing -> state finished >Thread-232::DEBUG::2012-11-29 13:55:45,102::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-232::DEBUG::2012-11-29 13:55:45,102::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-232::DEBUG::2012-11-29 13:55:45,102::task::957::TaskManager.Task::(_decref) Task=`d441e1f1-dfff-4eba-9aee-a826fc233a6c`::ref 0 aborting False >Thread-234::DEBUG::2012-11-29 13:55:46,950::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-234::DEBUG::2012-11-29 13:55:46,951::task::568::TaskManager.Task::(_updateState) Task=`3dd47901-4602-46e8-99f6-d1fe6532e4d4`::moving from state init -> state preparing >Thread-234::INFO::2012-11-29 13:55:46,951::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-234::INFO::2012-11-29 13:55:46,951::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-234::DEBUG::2012-11-29 13:55:46,951::task::1151::TaskManager.Task::(prepare) Task=`3dd47901-4602-46e8-99f6-d1fe6532e4d4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-234::DEBUG::2012-11-29 13:55:46,951::task::568::TaskManager.Task::(_updateState) Task=`3dd47901-4602-46e8-99f6-d1fe6532e4d4`::moving from state preparing -> state finished >Thread-234::DEBUG::2012-11-29 13:55:46,952::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-234::DEBUG::2012-11-29 13:55:46,952::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-234::DEBUG::2012-11-29 13:55:46,952::task::957::TaskManager.Task::(_decref) Task=`3dd47901-4602-46e8-99f6-d1fe6532e4d4`::ref 0 aborting False >Thread-235::DEBUG::2012-11-29 13:55:46,979::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-235::DEBUG::2012-11-29 13:55:46,979::task::568::TaskManager.Task::(_updateState) Task=`12fbc198-e8c8-413f-a0a9-58ca1a35de4d`::moving from state init -> state preparing >Thread-235::INFO::2012-11-29 13:55:46,979::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-235::DEBUG::2012-11-29 13:55:46,979::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`7497dd8d-77ba-417b-8646-494a7c58e5b0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-235::DEBUG::2012-11-29 13:55:46,980::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-235::DEBUG::2012-11-29 13:55:46,980::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-235::DEBUG::2012-11-29 13:55:46,980::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`7497dd8d-77ba-417b-8646-494a7c58e5b0`::Granted request >Thread-235::DEBUG::2012-11-29 13:55:46,980::task::794::TaskManager.Task::(resourceAcquired) Task=`12fbc198-e8c8-413f-a0a9-58ca1a35de4d`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-235::DEBUG::2012-11-29 13:55:46,980::task::957::TaskManager.Task::(_decref) Task=`12fbc198-e8c8-413f-a0a9-58ca1a35de4d`::ref 1 aborting False >Thread-235::INFO::2012-11-29 13:55:46,983::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859383529472', 'alerts': [], 'disktotal': '859388772352'}}} >Thread-235::DEBUG::2012-11-29 13:55:46,983::task::1151::TaskManager.Task::(prepare) Task=`12fbc198-e8c8-413f-a0a9-58ca1a35de4d`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859383529472', 'alerts': [], 'disktotal': '859388772352'}}} >Thread-235::DEBUG::2012-11-29 13:55:46,983::task::568::TaskManager.Task::(_updateState) Task=`12fbc198-e8c8-413f-a0a9-58ca1a35de4d`::moving from state preparing -> state finished >Thread-235::DEBUG::2012-11-29 13:55:46,983::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-235::DEBUG::2012-11-29 13:55:46,983::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-235::DEBUG::2012-11-29 13:55:46,984::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-235::DEBUG::2012-11-29 13:55:46,984::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-235::DEBUG::2012-11-29 13:55:46,984::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-235::DEBUG::2012-11-29 13:55:46,984::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-235::DEBUG::2012-11-29 13:55:46,984::task::957::TaskManager.Task::(_decref) Task=`12fbc198-e8c8-413f-a0a9-58ca1a35de4d`::ref 0 aborting False >Thread-237::DEBUG::2012-11-29 13:55:47,718::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-237::DEBUG::2012-11-29 13:55:47,719::task::568::TaskManager.Task::(_updateState) Task=`57c1bdd7-cc57-490f-8125-184869230c15`::moving from state init -> state preparing >Thread-237::INFO::2012-11-29 13:55:47,719::logUtils::37::dispatcher::(wrapper) Run and protect: removeVM(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', vmUUID='f6b0095a-88cc-47b0-8e7a-9b3599013d6a', sdUUID=None, options=None) >Thread-237::DEBUG::2012-11-29 13:55:47,719::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`36d68866-8af3-47b8-a7bb-e55d1ec31732`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-237::DEBUG::2012-11-29 13:55:47,719::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-237::DEBUG::2012-11-29 13:55:47,720::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-237::DEBUG::2012-11-29 13:55:47,720::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`36d68866-8af3-47b8-a7bb-e55d1ec31732`::Granted request >Thread-237::DEBUG::2012-11-29 13:55:47,720::task::794::TaskManager.Task::(resourceAcquired) Task=`57c1bdd7-cc57-490f-8125-184869230c15`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-237::DEBUG::2012-11-29 13:55:47,720::task::957::TaskManager.Task::(_decref) Task=`57c1bdd7-cc57-490f-8125-184869230c15`::ref 1 aborting False >Thread-237::INFO::2012-11-29 13:55:47,720::sp::1296::Storage.StoragePool::(removeVM) spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b vmUUID=f6b0095a-88cc-47b0-8e7a-9b3599013d6a sdUUID=None >Thread-237::INFO::2012-11-29 13:55:47,723::logUtils::39::dispatcher::(wrapper) Run and protect: removeVM, Return response: None >Thread-237::DEBUG::2012-11-29 13:55:47,723::task::1151::TaskManager.Task::(prepare) Task=`57c1bdd7-cc57-490f-8125-184869230c15`::finished: None >Thread-237::DEBUG::2012-11-29 13:55:47,723::task::568::TaskManager.Task::(_updateState) Task=`57c1bdd7-cc57-490f-8125-184869230c15`::moving from state preparing -> state finished >Thread-237::DEBUG::2012-11-29 13:55:47,723::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-237::DEBUG::2012-11-29 13:55:47,724::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-237::DEBUG::2012-11-29 13:55:47,724::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-237::DEBUG::2012-11-29 13:55:47,724::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-237::DEBUG::2012-11-29 13:55:47,724::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-237::DEBUG::2012-11-29 13:55:47,724::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-237::DEBUG::2012-11-29 13:55:47,724::task::957::TaskManager.Task::(_decref) Task=`57c1bdd7-cc57-490f-8125-184869230c15`::ref 0 aborting False >Thread-238::DEBUG::2012-11-29 13:55:47,775::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-238::DEBUG::2012-11-29 13:55:47,775::task::568::TaskManager.Task::(_updateState) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::moving from state init -> state preparing >Thread-238::INFO::2012-11-29 13:55:47,776::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', imgUUID='a20a37cd-4d93-4508-a1b3-8180d6a5b753', postZero='false', force='false') >Thread-238::INFO::2012-11-29 13:55:47,776::fileSD::302::Storage.StorageDomain::(validate) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-238::DEBUG::2012-11-29 13:55:47,779::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9ac9b8816517dc36c03957538bcd105774acb179'] >Thread-238::DEBUG::2012-11-29 13:55:47,779::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753`ReqID=`5d939d61-eb14-4725-8935-c4a732b3683e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-238::DEBUG::2012-11-29 13:55:47,779::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753' for lock type 'exclusive' >Thread-238::DEBUG::2012-11-29 13:55:47,780::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753' is free. Now locking as 'exclusive' (1 active user) >Thread-238::DEBUG::2012-11-29 13:55:47,780::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753`ReqID=`5d939d61-eb14-4725-8935-c4a732b3683e`::Granted request >Thread-238::DEBUG::2012-11-29 13:55:47,780::task::794::TaskManager.Task::(resourceAcquired) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::_resourcesAcquired: Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753 (exclusive) >Thread-238::DEBUG::2012-11-29 13:55:47,780::task::957::TaskManager.Task::(_decref) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::ref 1 aborting False >Thread-238::DEBUG::2012-11-29 13:55:47,781::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`fde462de-a05a-4847-bdbe-f47b49af63f8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-238::DEBUG::2012-11-29 13:55:47,781::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'shared' >Thread-238::DEBUG::2012-11-29 13:55:47,781::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'shared' (1 active user) >Thread-238::DEBUG::2012-11-29 13:55:47,781::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`fde462de-a05a-4847-bdbe-f47b49af63f8`::Granted request >Thread-238::DEBUG::2012-11-29 13:55:47,781::task::794::TaskManager.Task::(resourceAcquired) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (shared) >Thread-238::DEBUG::2012-11-29 13:55:47,782::task::957::TaskManager.Task::(_decref) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::ref 1 aborting False >Thread-238::DEBUG::2012-11-29 13:55:47,791::task::719::TaskManager.Task::(_save) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58.temp >Thread-238::DEBUG::2012-11-29 13:55:47,807::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_a20a37cd-4d93-4508-a1b3-8180d6a5b753 for task abeed7ab-76ea-49f6-b840-c52790fd7d58 >Thread-238::INFO::2012-11-29 13:55:47,807::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-238::DEBUG::2012-11-29 13:55:47,807::task::1146::TaskManager.Task::(prepare) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::Prepare: 1 jobs exist, move to acquiring >Thread-238::DEBUG::2012-11-29 13:55:47,807::task::568::TaskManager.Task::(_updateState) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::moving from state preparing -> state acquiring >Thread-238::DEBUG::2012-11-29 13:55:47,808::task::719::TaskManager.Task::(_save) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58.temp >Thread-238::DEBUG::2012-11-29 13:55:47,819::task::568::TaskManager.Task::(_updateState) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::moving from state acquiring -> state queued >Thread-238::DEBUG::2012-11-29 13:55:47,819::task::719::TaskManager.Task::(_save) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58.temp >Thread-238::DEBUG::2012-11-29 13:55:47,831::taskManager::50::TaskManager::(_queueTask) queuing task: abeed7ab-76ea-49f6-b840-c52790fd7d58 >Thread-238::DEBUG::2012-11-29 13:55:47,831::taskManager::56::TaskManager::(_queueTask) task queued: abeed7ab-76ea-49f6-b840-c52790fd7d58 >b8ebf1dc-ed34-475e-b3fe-a7934a8a6749::DEBUG::2012-11-29 13:55:47,831::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-238::DEBUG::2012-11-29 13:55:47,831::task::1148::TaskManager.Task::(prepare) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::returning >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,832::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: abeed7ab-76ea-49f6-b840-c52790fd7d58 running: <bound method Task.commit of <storage.task.Task instance at 0x7f417c364830>> with: None >Thread-238::DEBUG::2012-11-29 13:55:47,832::task::957::TaskManager.Task::(_decref) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::ref 0 aborting False >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,832::task::1159::TaskManager.Task::(commit) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::committing task: abeed7ab-76ea-49f6-b840-c52790fd7d58 >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,833::task::568::TaskManager.Task::(_updateState) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::moving from state queued -> state running >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,834::task::719::TaskManager.Task::(_save) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58.temp >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,844::task::872::TaskManager.Task::(_runJobs) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::Task.run: running job 0: deleteImage_a20a37cd-4d93-4508-a1b3-8180d6a5b753: <function <lambda> at 0x7f417c360b18> (args: () kwargs: {}) >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,845::task::304::TaskManager.Task::(run) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::Job.run: running deleteImage_a20a37cd-4d93-4508-a1b3-8180d6a5b753: <function <lambda> at 0x7f417c360b18> (args: () kwargs: {}) callback None >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,845::task::568::TaskManager.Task::(_updateState) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::moving from state running -> state finished >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,845::task::719::TaskManager.Task::(_save) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::_save: orig /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58 temp /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd/master/tasks/abeed7ab-76ea-49f6-b840-c52790fd7d58.temp >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,858::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753': < ResourceRef 'Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753', isValid: 'True' obj: 'None'>, 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,858::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,859::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753' >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,859::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753' (0 active users) >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,859::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753' is free, finding out if anyone is waiting for it. >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,859::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a20a37cd-4d93-4508-a1b3-8180d6a5b753', Clearing records. >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,859::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,860::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,860::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,860::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,860::task::880::TaskManager.Task::(_runJobs) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::Task.run: exit - success: result True >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,860::task::957::TaskManager.Task::(_decref) Task=`abeed7ab-76ea-49f6-b840-c52790fd7d58`::ref 0 aborting False >abeed7ab-76ea-49f6-b840-c52790fd7d58::DEBUG::2012-11-29 13:55:47,861::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-240::DEBUG::2012-11-29 13:55:51,128::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-240::DEBUG::2012-11-29 13:55:51,129::task::568::TaskManager.Task::(_updateState) Task=`1c69f5ef-8765-4a16-a36c-d5baa52db4a5`::moving from state init -> state preparing >Thread-240::INFO::2012-11-29 13:55:51,129::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-240::DEBUG::2012-11-29 13:55:51,129::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-240::DEBUG::2012-11-29 13:55:51,129::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: abeed7ab-76ea-49f6-b840-c52790fd7d58 >Thread-240::DEBUG::2012-11-29 13:55:51,129::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'abeed7ab-76ea-49f6-b840-c52790fd7d58'} >Thread-240::DEBUG::2012-11-29 13:55:51,130::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'abeed7ab-76ea-49f6-b840-c52790fd7d58': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'abeed7ab-76ea-49f6-b840-c52790fd7d58'}} >Thread-240::INFO::2012-11-29 13:55:51,130::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'abeed7ab-76ea-49f6-b840-c52790fd7d58': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'abeed7ab-76ea-49f6-b840-c52790fd7d58'}}} >Thread-240::DEBUG::2012-11-29 13:55:51,130::task::1151::TaskManager.Task::(prepare) Task=`1c69f5ef-8765-4a16-a36c-d5baa52db4a5`::finished: {'allTasksStatus': {'abeed7ab-76ea-49f6-b840-c52790fd7d58': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'abeed7ab-76ea-49f6-b840-c52790fd7d58'}}} >Thread-240::DEBUG::2012-11-29 13:55:51,130::task::568::TaskManager.Task::(_updateState) Task=`1c69f5ef-8765-4a16-a36c-d5baa52db4a5`::moving from state preparing -> state finished >Thread-240::DEBUG::2012-11-29 13:55:51,130::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-240::DEBUG::2012-11-29 13:55:51,130::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-240::DEBUG::2012-11-29 13:55:51,131::task::957::TaskManager.Task::(_decref) Task=`1c69f5ef-8765-4a16-a36c-d5baa52db4a5`::ref 0 aborting False >Thread-241::DEBUG::2012-11-29 13:55:51,197::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-241::DEBUG::2012-11-29 13:55:51,197::task::568::TaskManager.Task::(_updateState) Task=`8f2fa808-6e73-411b-b06b-8266cc7f212b`::moving from state init -> state preparing >Thread-241::INFO::2012-11-29 13:55:51,198::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='abeed7ab-76ea-49f6-b840-c52790fd7d58', spUUID=None, options=None) >Thread-241::DEBUG::2012-11-29 13:55:51,198::taskManager::161::TaskManager::(clearTask) Entry. taskID: abeed7ab-76ea-49f6-b840-c52790fd7d58 >Thread-241::DEBUG::2012-11-29 13:55:51,202::taskManager::166::TaskManager::(clearTask) Return. >Thread-241::INFO::2012-11-29 13:55:51,202::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-241::DEBUG::2012-11-29 13:55:51,202::task::1151::TaskManager.Task::(prepare) Task=`8f2fa808-6e73-411b-b06b-8266cc7f212b`::finished: None >Thread-241::DEBUG::2012-11-29 13:55:51,202::task::568::TaskManager.Task::(_updateState) Task=`8f2fa808-6e73-411b-b06b-8266cc7f212b`::moving from state preparing -> state finished >Thread-241::DEBUG::2012-11-29 13:55:51,202::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-241::DEBUG::2012-11-29 13:55:51,203::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-241::DEBUG::2012-11-29 13:55:51,203::task::957::TaskManager.Task::(_decref) Task=`8f2fa808-6e73-411b-b06b-8266cc7f212b`::ref 0 aborting False >Thread-244::DEBUG::2012-11-29 13:55:55,323::task::568::TaskManager.Task::(_updateState) Task=`7485944e-f319-42a2-9a1e-74ac0f52f423`::moving from state init -> state preparing >Thread-244::INFO::2012-11-29 13:55:55,324::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-244::INFO::2012-11-29 13:55:55,324::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00235104560852', 'lastCheck': '10.0', 'code': 0, 'valid': True}} >Thread-244::DEBUG::2012-11-29 13:55:55,324::task::1151::TaskManager.Task::(prepare) Task=`7485944e-f319-42a2-9a1e-74ac0f52f423`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00235104560852', 'lastCheck': '10.0', 'code': 0, 'valid': True}} >Thread-244::DEBUG::2012-11-29 13:55:55,325::task::568::TaskManager.Task::(_updateState) Task=`7485944e-f319-42a2-9a1e-74ac0f52f423`::moving from state preparing -> state finished >Thread-244::DEBUG::2012-11-29 13:55:55,325::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-244::DEBUG::2012-11-29 13:55:55,326::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-244::DEBUG::2012-11-29 13:55:55,326::task::957::TaskManager.Task::(_decref) Task=`7485944e-f319-42a2-9a1e-74ac0f52f423`::ref 0 aborting False >Thread-246::DEBUG::2012-11-29 13:55:57,084::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-246::DEBUG::2012-11-29 13:55:57,084::task::568::TaskManager.Task::(_updateState) Task=`4dc189fd-db1a-4c99-8cc1-788b8ac72a1b`::moving from state init -> state preparing >Thread-246::INFO::2012-11-29 13:55:57,084::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-246::INFO::2012-11-29 13:55:57,085::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-246::DEBUG::2012-11-29 13:55:57,085::task::1151::TaskManager.Task::(prepare) Task=`4dc189fd-db1a-4c99-8cc1-788b8ac72a1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-246::DEBUG::2012-11-29 13:55:57,085::task::568::TaskManager.Task::(_updateState) Task=`4dc189fd-db1a-4c99-8cc1-788b8ac72a1b`::moving from state preparing -> state finished >Thread-246::DEBUG::2012-11-29 13:55:57,085::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-246::DEBUG::2012-11-29 13:55:57,085::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-246::DEBUG::2012-11-29 13:55:57,085::task::957::TaskManager.Task::(_decref) Task=`4dc189fd-db1a-4c99-8cc1-788b8ac72a1b`::ref 0 aborting False >Thread-247::DEBUG::2012-11-29 13:55:57,112::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-247::DEBUG::2012-11-29 13:55:57,112::task::568::TaskManager.Task::(_updateState) Task=`8aa66d59-3e25-41a5-b0ad-0fde1fac7dae`::moving from state init -> state preparing >Thread-247::INFO::2012-11-29 13:55:57,112::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-247::DEBUG::2012-11-29 13:55:57,112::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`3bdc44a9-6574-45ea-a924-dbc4b5bc07f5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-247::DEBUG::2012-11-29 13:55:57,113::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-247::DEBUG::2012-11-29 13:55:57,113::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-247::DEBUG::2012-11-29 13:55:57,113::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`3bdc44a9-6574-45ea-a924-dbc4b5bc07f5`::Granted request >Thread-247::DEBUG::2012-11-29 13:55:57,113::task::794::TaskManager.Task::(resourceAcquired) Task=`8aa66d59-3e25-41a5-b0ad-0fde1fac7dae`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-247::DEBUG::2012-11-29 13:55:57,113::task::957::TaskManager.Task::(_decref) Task=`8aa66d59-3e25-41a5-b0ad-0fde1fac7dae`::ref 1 aborting False >Thread-247::INFO::2012-11-29 13:55:57,116::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859383529472', 'alerts': [], 'disktotal': '859388772352'}}} >Thread-247::DEBUG::2012-11-29 13:55:57,116::task::1151::TaskManager.Task::(prepare) Task=`8aa66d59-3e25-41a5-b0ad-0fde1fac7dae`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859383529472', 'alerts': [], 'disktotal': '859388772352'}}} >Thread-247::DEBUG::2012-11-29 13:55:57,116::task::568::TaskManager.Task::(_updateState) Task=`8aa66d59-3e25-41a5-b0ad-0fde1fac7dae`::moving from state preparing -> state finished >Thread-247::DEBUG::2012-11-29 13:55:57,116::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-247::DEBUG::2012-11-29 13:55:57,116::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-247::DEBUG::2012-11-29 13:55:57,116::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-247::DEBUG::2012-11-29 13:55:57,117::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-247::DEBUG::2012-11-29 13:55:57,117::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-247::DEBUG::2012-11-29 13:55:57,117::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-247::DEBUG::2012-11-29 13:55:57,117::task::957::TaskManager.Task::(_decref) Task=`8aa66d59-3e25-41a5-b0ad-0fde1fac7dae`::ref 0 aborting False >Thread-252::DEBUG::2012-11-29 13:56:05,558::task::568::TaskManager.Task::(_updateState) Task=`3a80af07-b8f1-468b-a0d8-18508b9e4477`::moving from state init -> state preparing >Thread-252::INFO::2012-11-29 13:56:05,558::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-252::INFO::2012-11-29 13:56:05,558::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.0026650428772', 'lastCheck': '0.2', 'code': 0, 'valid': True}} >Thread-252::DEBUG::2012-11-29 13:56:05,559::task::1151::TaskManager.Task::(prepare) Task=`3a80af07-b8f1-468b-a0d8-18508b9e4477`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.0026650428772', 'lastCheck': '0.2', 'code': 0, 'valid': True}} >Thread-252::DEBUG::2012-11-29 13:56:05,559::task::568::TaskManager.Task::(_updateState) Task=`3a80af07-b8f1-468b-a0d8-18508b9e4477`::moving from state preparing -> state finished >Thread-252::DEBUG::2012-11-29 13:56:05,559::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-252::DEBUG::2012-11-29 13:56:05,559::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-252::DEBUG::2012-11-29 13:56:05,559::task::957::TaskManager.Task::(_decref) Task=`3a80af07-b8f1-468b-a0d8-18508b9e4477`::ref 0 aborting False >Thread-254::DEBUG::2012-11-29 13:56:07,158::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-254::DEBUG::2012-11-29 13:56:07,158::task::568::TaskManager.Task::(_updateState) Task=`4d3ebdfc-356a-46ec-a6ae-562f37cb728d`::moving from state init -> state preparing >Thread-254::INFO::2012-11-29 13:56:07,158::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-254::INFO::2012-11-29 13:56:07,158::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-254::DEBUG::2012-11-29 13:56:07,159::task::1151::TaskManager.Task::(prepare) Task=`4d3ebdfc-356a-46ec-a6ae-562f37cb728d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-254::DEBUG::2012-11-29 13:56:07,159::task::568::TaskManager.Task::(_updateState) Task=`4d3ebdfc-356a-46ec-a6ae-562f37cb728d`::moving from state preparing -> state finished >Thread-254::DEBUG::2012-11-29 13:56:07,159::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-254::DEBUG::2012-11-29 13:56:07,159::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-254::DEBUG::2012-11-29 13:56:07,159::task::957::TaskManager.Task::(_decref) Task=`4d3ebdfc-356a-46ec-a6ae-562f37cb728d`::ref 0 aborting False >Thread-255::DEBUG::2012-11-29 13:56:07,182::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-255::DEBUG::2012-11-29 13:56:07,182::task::568::TaskManager.Task::(_updateState) Task=`f5419db2-2068-4f86-a542-348d227da02a`::moving from state init -> state preparing >Thread-255::INFO::2012-11-29 13:56:07,182::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-255::DEBUG::2012-11-29 13:56:07,183::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`01d3d9ab-1818-4d42-9faa-58efca6179b0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-255::DEBUG::2012-11-29 13:56:07,183::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-255::DEBUG::2012-11-29 13:56:07,183::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-255::DEBUG::2012-11-29 13:56:07,183::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`01d3d9ab-1818-4d42-9faa-58efca6179b0`::Granted request >Thread-255::DEBUG::2012-11-29 13:56:07,184::task::794::TaskManager.Task::(resourceAcquired) Task=`f5419db2-2068-4f86-a542-348d227da02a`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-255::DEBUG::2012-11-29 13:56:07,184::task::957::TaskManager.Task::(_decref) Task=`f5419db2-2068-4f86-a542-348d227da02a`::ref 1 aborting False >Thread-255::INFO::2012-11-29 13:56:07,186::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859326906368', 'alerts': [], 'disktotal': '859329003520'}}} >Thread-255::DEBUG::2012-11-29 13:56:07,186::task::1151::TaskManager.Task::(prepare) Task=`f5419db2-2068-4f86-a542-348d227da02a`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859326906368', 'alerts': [], 'disktotal': '859329003520'}}} >Thread-255::DEBUG::2012-11-29 13:56:07,186::task::568::TaskManager.Task::(_updateState) Task=`f5419db2-2068-4f86-a542-348d227da02a`::moving from state preparing -> state finished >Thread-255::DEBUG::2012-11-29 13:56:07,186::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-255::DEBUG::2012-11-29 13:56:07,187::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-255::DEBUG::2012-11-29 13:56:07,187::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-255::DEBUG::2012-11-29 13:56:07,187::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-255::DEBUG::2012-11-29 13:56:07,187::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-255::DEBUG::2012-11-29 13:56:07,187::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-255::DEBUG::2012-11-29 13:56:07,188::task::957::TaskManager.Task::(_decref) Task=`f5419db2-2068-4f86-a542-348d227da02a`::ref 0 aborting False >Thread-260::DEBUG::2012-11-29 13:56:15,762::task::568::TaskManager.Task::(_updateState) Task=`a0cff74b-f892-499b-b07a-1e9e631a4b57`::moving from state init -> state preparing >Thread-260::INFO::2012-11-29 13:56:15,762::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-260::INFO::2012-11-29 13:56:15,762::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00213479995728', 'lastCheck': '0.4', 'code': 0, 'valid': True}} >Thread-260::DEBUG::2012-11-29 13:56:15,762::task::1151::TaskManager.Task::(prepare) Task=`a0cff74b-f892-499b-b07a-1e9e631a4b57`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00213479995728', 'lastCheck': '0.4', 'code': 0, 'valid': True}} >Thread-260::DEBUG::2012-11-29 13:56:15,763::task::568::TaskManager.Task::(_updateState) Task=`a0cff74b-f892-499b-b07a-1e9e631a4b57`::moving from state preparing -> state finished >Thread-260::DEBUG::2012-11-29 13:56:15,763::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-260::DEBUG::2012-11-29 13:56:15,763::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-260::DEBUG::2012-11-29 13:56:15,763::task::957::TaskManager.Task::(_decref) Task=`a0cff74b-f892-499b-b07a-1e9e631a4b57`::ref 0 aborting False >Thread-262::DEBUG::2012-11-29 13:56:17,253::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-262::DEBUG::2012-11-29 13:56:17,253::task::568::TaskManager.Task::(_updateState) Task=`3b75d1c6-916a-401c-8933-991e82cf20c7`::moving from state init -> state preparing >Thread-262::INFO::2012-11-29 13:56:17,254::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-262::INFO::2012-11-29 13:56:17,254::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-262::DEBUG::2012-11-29 13:56:17,254::task::1151::TaskManager.Task::(prepare) Task=`3b75d1c6-916a-401c-8933-991e82cf20c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-262::DEBUG::2012-11-29 13:56:17,254::task::568::TaskManager.Task::(_updateState) Task=`3b75d1c6-916a-401c-8933-991e82cf20c7`::moving from state preparing -> state finished >Thread-262::DEBUG::2012-11-29 13:56:17,254::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-262::DEBUG::2012-11-29 13:56:17,255::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-262::DEBUG::2012-11-29 13:56:17,255::task::957::TaskManager.Task::(_decref) Task=`3b75d1c6-916a-401c-8933-991e82cf20c7`::ref 0 aborting False >Thread-263::DEBUG::2012-11-29 13:56:17,281::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-263::DEBUG::2012-11-29 13:56:17,281::task::568::TaskManager.Task::(_updateState) Task=`9402fe9c-9a07-4ad5-90f9-e95a92a3b9bb`::moving from state init -> state preparing >Thread-263::INFO::2012-11-29 13:56:17,281::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-263::DEBUG::2012-11-29 13:56:17,282::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`7f7b41ae-5e52-4f99-b695-94f9ec88c9a6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-263::DEBUG::2012-11-29 13:56:17,282::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-263::DEBUG::2012-11-29 13:56:17,282::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-263::DEBUG::2012-11-29 13:56:17,282::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`7f7b41ae-5e52-4f99-b695-94f9ec88c9a6`::Granted request >Thread-263::DEBUG::2012-11-29 13:56:17,283::task::794::TaskManager.Task::(resourceAcquired) Task=`9402fe9c-9a07-4ad5-90f9-e95a92a3b9bb`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-263::DEBUG::2012-11-29 13:56:17,283::task::957::TaskManager.Task::(_decref) Task=`9402fe9c-9a07-4ad5-90f9-e95a92a3b9bb`::ref 1 aborting False >Thread-263::INFO::2012-11-29 13:56:17,286::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859326906368', 'alerts': [], 'disktotal': '859329003520'}}} >Thread-263::DEBUG::2012-11-29 13:56:17,286::task::1151::TaskManager.Task::(prepare) Task=`9402fe9c-9a07-4ad5-90f9-e95a92a3b9bb`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859326906368', 'alerts': [], 'disktotal': '859329003520'}}} >Thread-263::DEBUG::2012-11-29 13:56:17,286::task::568::TaskManager.Task::(_updateState) Task=`9402fe9c-9a07-4ad5-90f9-e95a92a3b9bb`::moving from state preparing -> state finished >Thread-263::DEBUG::2012-11-29 13:56:17,287::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-263::DEBUG::2012-11-29 13:56:17,287::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-263::DEBUG::2012-11-29 13:56:17,287::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-263::DEBUG::2012-11-29 13:56:17,287::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-263::DEBUG::2012-11-29 13:56:17,287::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-263::DEBUG::2012-11-29 13:56:17,288::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-263::DEBUG::2012-11-29 13:56:17,288::task::957::TaskManager.Task::(_decref) Task=`9402fe9c-9a07-4ad5-90f9-e95a92a3b9bb`::ref 0 aborting False >Thread-268::DEBUG::2012-11-29 13:56:25,962::task::568::TaskManager.Task::(_updateState) Task=`20193780-ac90-4885-a62d-3abb889a0a34`::moving from state init -> state preparing >Thread-268::INFO::2012-11-29 13:56:25,962::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-268::INFO::2012-11-29 13:56:25,962::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00213003158569', 'lastCheck': '0.6', 'code': 0, 'valid': True}} >Thread-268::DEBUG::2012-11-29 13:56:25,962::task::1151::TaskManager.Task::(prepare) Task=`20193780-ac90-4885-a62d-3abb889a0a34`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00213003158569', 'lastCheck': '0.6', 'code': 0, 'valid': True}} >Thread-268::DEBUG::2012-11-29 13:56:25,963::task::568::TaskManager.Task::(_updateState) Task=`20193780-ac90-4885-a62d-3abb889a0a34`::moving from state preparing -> state finished >Thread-268::DEBUG::2012-11-29 13:56:25,963::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-268::DEBUG::2012-11-29 13:56:25,963::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-268::DEBUG::2012-11-29 13:56:25,963::task::957::TaskManager.Task::(_decref) Task=`20193780-ac90-4885-a62d-3abb889a0a34`::ref 0 aborting False >Thread-270::DEBUG::2012-11-29 13:56:27,330::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-270::DEBUG::2012-11-29 13:56:27,330::task::568::TaskManager.Task::(_updateState) Task=`2a89cf03-e1dc-4ca1-b191-1de6fc1bbda9`::moving from state init -> state preparing >Thread-270::INFO::2012-11-29 13:56:27,330::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-270::INFO::2012-11-29 13:56:27,330::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-270::DEBUG::2012-11-29 13:56:27,331::task::1151::TaskManager.Task::(prepare) Task=`2a89cf03-e1dc-4ca1-b191-1de6fc1bbda9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-270::DEBUG::2012-11-29 13:56:27,331::task::568::TaskManager.Task::(_updateState) Task=`2a89cf03-e1dc-4ca1-b191-1de6fc1bbda9`::moving from state preparing -> state finished >Thread-270::DEBUG::2012-11-29 13:56:27,331::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-270::DEBUG::2012-11-29 13:56:27,331::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-270::DEBUG::2012-11-29 13:56:27,331::task::957::TaskManager.Task::(_decref) Task=`2a89cf03-e1dc-4ca1-b191-1de6fc1bbda9`::ref 0 aborting False >Thread-271::DEBUG::2012-11-29 13:56:27,360::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-271::DEBUG::2012-11-29 13:56:27,360::task::568::TaskManager.Task::(_updateState) Task=`13ec5ffb-3913-4c19-9700-ea2f81ac5a1e`::moving from state init -> state preparing >Thread-271::INFO::2012-11-29 13:56:27,360::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-271::DEBUG::2012-11-29 13:56:27,361::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`0c89b02f-68f5-4686-beed-99b4eb34af4d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-271::DEBUG::2012-11-29 13:56:27,361::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'shared' >Thread-271::DEBUG::2012-11-29 13:56:27,361::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'shared' (1 active user) >Thread-271::DEBUG::2012-11-29 13:56:27,361::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`0c89b02f-68f5-4686-beed-99b4eb34af4d`::Granted request >Thread-271::DEBUG::2012-11-29 13:56:27,361::task::794::TaskManager.Task::(resourceAcquired) Task=`13ec5ffb-3913-4c19-9700-ea2f81ac5a1e`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (shared) >Thread-271::DEBUG::2012-11-29 13:56:27,362::task::957::TaskManager.Task::(_decref) Task=`13ec5ffb-3913-4c19-9700-ea2f81ac5a1e`::ref 1 aborting False >Thread-271::INFO::2012-11-29 13:56:27,364::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859326906368', 'alerts': [], 'disktotal': '859329003520'}}} >Thread-271::DEBUG::2012-11-29 13:56:27,364::task::1151::TaskManager.Task::(prepare) Task=`13ec5ffb-3913-4c19-9700-ea2f81ac5a1e`::finished: {'info': {'spm_id': 1, 'master_uuid': '81105f27-0d06-428d-bedf-308ae0109fb5', 'name': 'DefaultRest', 'version': '3', 'domains': '81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'81105f27-0d06-428d-bedf-308ae0109fb5': {'status': 'Active', 'diskfree': '859326906368', 'alerts': [], 'disktotal': '859329003520'}}} >Thread-271::DEBUG::2012-11-29 13:56:27,364::task::568::TaskManager.Task::(_updateState) Task=`13ec5ffb-3913-4c19-9700-ea2f81ac5a1e`::moving from state preparing -> state finished >Thread-271::DEBUG::2012-11-29 13:56:27,364::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-271::DEBUG::2012-11-29 13:56:27,364::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-271::DEBUG::2012-11-29 13:56:27,365::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-271::DEBUG::2012-11-29 13:56:27,365::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-271::DEBUG::2012-11-29 13:56:27,365::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-271::DEBUG::2012-11-29 13:56:27,365::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-271::DEBUG::2012-11-29 13:56:27,365::task::957::TaskManager.Task::(_decref) Task=`13ec5ffb-3913-4c19-9700-ea2f81ac5a1e`::ref 0 aborting False >Thread-273::DEBUG::2012-11-29 13:56:29,537::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-273::DEBUG::2012-11-29 13:56:29,538::task::568::TaskManager.Task::(_updateState) Task=`f6664ea6-df3c-43e1-b314-4eab164792a2`::moving from state init -> state preparing >Thread-273::INFO::2012-11-29 13:56:29,538::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-273::DEBUG::2012-11-29 13:56:29,538::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`bf601382-b6f1-4d8c-98d8-c193698e98f7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-273::DEBUG::2012-11-29 13:56:29,538::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-273::DEBUG::2012-11-29 13:56:29,539::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-273::DEBUG::2012-11-29 13:56:29,539::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`bf601382-b6f1-4d8c-98d8-c193698e98f7`::Granted request >Thread-273::DEBUG::2012-11-29 13:56:29,539::task::794::TaskManager.Task::(resourceAcquired) Task=`f6664ea6-df3c-43e1-b314-4eab164792a2`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (exclusive) >Thread-273::DEBUG::2012-11-29 13:56:29,539::task::957::TaskManager.Task::(_decref) Task=`f6664ea6-df3c-43e1-b314-4eab164792a2`::ref 1 aborting False >Thread-273::DEBUG::2012-11-29 13:56:29,540::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`ab048e7e-7b26-4bee-8657-6eadadcb558d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-273::DEBUG::2012-11-29 13:56:29,540::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'exclusive' >Thread-273::DEBUG::2012-11-29 13:56:29,540::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'exclusive' (1 active user) >Thread-273::DEBUG::2012-11-29 13:56:29,540::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`ab048e7e-7b26-4bee-8657-6eadadcb558d`::Granted request >Thread-273::DEBUG::2012-11-29 13:56:29,540::task::794::TaskManager.Task::(resourceAcquired) Task=`f6664ea6-df3c-43e1-b314-4eab164792a2`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (exclusive) >Thread-273::DEBUG::2012-11-29 13:56:29,541::task::957::TaskManager.Task::(_decref) Task=`f6664ea6-df3c-43e1-b314-4eab164792a2`::ref 1 aborting False >Thread-273::INFO::2012-11-29 13:56:29,541::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=81105f27-0d06-428d-bedf-308ae0109fb5 spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-273::INFO::2012-11-29 13:56:29,541::sp::1103::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-273::INFO::2012-11-29 13:56:29,541::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-273::DEBUG::2012-11-29 13:56:29,541::task::1151::TaskManager.Task::(prepare) Task=`f6664ea6-df3c-43e1-b314-4eab164792a2`::finished: None >Thread-273::DEBUG::2012-11-29 13:56:29,541::task::568::TaskManager.Task::(_updateState) Task=`f6664ea6-df3c-43e1-b314-4eab164792a2`::moving from state preparing -> state finished >Thread-273::DEBUG::2012-11-29 13:56:29,542::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>, 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-273::DEBUG::2012-11-29 13:56:29,542::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-273::DEBUG::2012-11-29 13:56:29,542::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-273::DEBUG::2012-11-29 13:56:29,542::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-273::DEBUG::2012-11-29 13:56:29,542::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-273::DEBUG::2012-11-29 13:56:29,542::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-273::DEBUG::2012-11-29 13:56:29,543::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-273::DEBUG::2012-11-29 13:56:29,543::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-273::DEBUG::2012-11-29 13:56:29,543::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-273::DEBUG::2012-11-29 13:56:29,543::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-273::DEBUG::2012-11-29 13:56:29,543::task::957::TaskManager.Task::(_decref) Task=`f6664ea6-df3c-43e1-b314-4eab164792a2`::ref 0 aborting False >Thread-274::DEBUG::2012-11-29 13:56:29,593::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-274::DEBUG::2012-11-29 13:56:29,593::task::568::TaskManager.Task::(_updateState) Task=`f51f1d7b-7ade-47b6-9a14-951007558025`::moving from state init -> state preparing >Thread-274::INFO::2012-11-29 13:56:29,593::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-274::DEBUG::2012-11-29 13:56:29,594::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-274::DEBUG::2012-11-29 13:56:29,594::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-274::INFO::2012-11-29 13:56:29,594::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-274::DEBUG::2012-11-29 13:56:29,594::task::1151::TaskManager.Task::(prepare) Task=`f51f1d7b-7ade-47b6-9a14-951007558025`::finished: {'allTasksStatus': {}} >Thread-274::DEBUG::2012-11-29 13:56:29,594::task::568::TaskManager.Task::(_updateState) Task=`f51f1d7b-7ade-47b6-9a14-951007558025`::moving from state preparing -> state finished >Thread-274::DEBUG::2012-11-29 13:56:29,594::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-274::DEBUG::2012-11-29 13:56:29,594::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-274::DEBUG::2012-11-29 13:56:29,595::task::957::TaskManager.Task::(_decref) Task=`f51f1d7b-7ade-47b6-9a14-951007558025`::ref 0 aborting False >Thread-275::DEBUG::2012-11-29 13:56:29,619::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-275::DEBUG::2012-11-29 13:56:29,619::task::568::TaskManager.Task::(_updateState) Task=`02b2faae-4ed3-43c3-a344-7d32c0c85703`::moving from state init -> state preparing >Thread-275::INFO::2012-11-29 13:56:29,619::logUtils::37::dispatcher::(wrapper) Run and protect: spmStop(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-275::DEBUG::2012-11-29 13:56:29,619::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`4f9fa26d-9db2-4db2-afaa-8d30f4491c62`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-275::DEBUG::2012-11-29 13:56:29,620::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-275::DEBUG::2012-11-29 13:56:29,620::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-275::DEBUG::2012-11-29 13:56:29,620::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`4f9fa26d-9db2-4db2-afaa-8d30f4491c62`::Granted request >Thread-275::DEBUG::2012-11-29 13:56:29,620::task::794::TaskManager.Task::(resourceAcquired) Task=`02b2faae-4ed3-43c3-a344-7d32c0c85703`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (exclusive) >Thread-275::DEBUG::2012-11-29 13:56:29,620::task::957::TaskManager.Task::(_decref) Task=`02b2faae-4ed3-43c3-a344-7d32c0c85703`::ref 1 aborting False >Thread-275::DEBUG::2012-11-29 13:56:29,621::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-275::DEBUG::2012-11-29 13:56:29,621::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`d0066bdd-558d-4a60-b5d3-c0b414c41777`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-275::DEBUG::2012-11-29 13:56:29,621::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-275::DEBUG::2012-11-29 13:56:29,621::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-275::DEBUG::2012-11-29 13:56:29,621::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`d0066bdd-558d-4a60-b5d3-c0b414c41777`::Granted request >Thread-275::DEBUG::2012-11-29 13:56:29,622::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-275::DEBUG::2012-11-29 13:56:29,622::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-275::DEBUG::2012-11-29 13:56:29,622::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-275::DEBUG::2012-11-29 13:56:29,622::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-275::DEBUG::2012-11-29 13:56:29,625::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,627::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,628::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,630::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,631::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,633::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,634::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,636::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,637::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,639::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,641::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,642::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,644::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,645::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,647::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,648::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,650::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,651::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,653::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,654::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,656::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,657::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,659::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,660::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,662::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,663::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,665::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,667::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,668::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,670::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,671::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,673::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,674::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,676::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,677::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,679::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,680::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,682::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,683::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,685::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,686::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,688::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,689::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,691::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >Thread-275::DEBUG::2012-11-29 13:56:29,691::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-275::DEBUG::2012-11-29 13:56:29,691::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-275::DEBUG::2012-11-29 13:56:29,692::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a2c503c9b50cbea17306296ccc7c2b7b63d1dc8f'] >Thread-275::DEBUG::2012-11-29 13:56:29,695::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-275::INFO::2012-11-29 13:56:29,695::safelease::239::SANLock::(release) Releasing cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-275::DEBUG::2012-11-29 13:56:29,698::safelease::250::SANLock::(release) Cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully released >Thread-275::INFO::2012-11-29 13:56:29,698::logUtils::39::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-275::DEBUG::2012-11-29 13:56:29,698::task::1151::TaskManager.Task::(prepare) Task=`02b2faae-4ed3-43c3-a344-7d32c0c85703`::finished: None >Thread-275::DEBUG::2012-11-29 13:56:29,699::task::568::TaskManager.Task::(_updateState) Task=`02b2faae-4ed3-43c3-a344-7d32c0c85703`::moving from state preparing -> state finished >Thread-275::DEBUG::2012-11-29 13:56:29,699::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-275::DEBUG::2012-11-29 13:56:29,699::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-275::DEBUG::2012-11-29 13:56:29,699::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-275::DEBUG::2012-11-29 13:56:29,699::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-275::DEBUG::2012-11-29 13:56:29,700::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-275::DEBUG::2012-11-29 13:56:29,700::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-275::DEBUG::2012-11-29 13:56:29,700::task::957::TaskManager.Task::(_decref) Task=`02b2faae-4ed3-43c3-a344-7d32c0c85703`::ref 0 aborting False >Thread-276::DEBUG::2012-11-29 13:56:29,734::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-276::DEBUG::2012-11-29 13:56:29,735::task::568::TaskManager.Task::(_updateState) Task=`e11fe16e-c72b-458d-b395-316e0fc70906`::moving from state init -> state preparing >Thread-276::INFO::2012-11-29 13:56:29,735::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', hostID=1, scsiKey='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', remove=False, options=None) >Thread-276::DEBUG::2012-11-29 13:56:29,735::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`7b6f5a3e-ab7a-44a2-9874-869c9390cf57`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-276::DEBUG::2012-11-29 13:56:29,736::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-276::DEBUG::2012-11-29 13:56:29,736::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-276::DEBUG::2012-11-29 13:56:29,736::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`7b6f5a3e-ab7a-44a2-9874-869c9390cf57`::Granted request >Thread-276::DEBUG::2012-11-29 13:56:29,736::task::794::TaskManager.Task::(resourceAcquired) Task=`e11fe16e-c72b-458d-b395-316e0fc70906`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (exclusive) >Thread-276::DEBUG::2012-11-29 13:56:29,736::task::957::TaskManager.Task::(_decref) Task=`e11fe16e-c72b-458d-b395-316e0fc70906`::ref 1 aborting False >Thread-276::INFO::2012-11-29 13:56:29,737::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 1354c897-ef7d-4edf-aa4c-c1e1464d0e2b >Thread-72::DEBUG::2012-11-29 13:56:29,737::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-72::INFO::2012-11-29 13:56:29,737::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 1) >Thread-72::DEBUG::2012-11-29 13:56:31,738::safelease::193::SANLock::(releaseHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 released successfully (id: 1) >Thread-276::INFO::2012-11-29 13:56:31,738::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-276::DEBUG::2012-11-29 13:56:31,738::task::1151::TaskManager.Task::(prepare) Task=`e11fe16e-c72b-458d-b395-316e0fc70906`::finished: True >Thread-276::DEBUG::2012-11-29 13:56:31,738::task::568::TaskManager.Task::(_updateState) Task=`e11fe16e-c72b-458d-b395-316e0fc70906`::moving from state preparing -> state finished >Thread-276::DEBUG::2012-11-29 13:56:31,739::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-276::DEBUG::2012-11-29 13:56:31,739::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-276::DEBUG::2012-11-29 13:56:31,739::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-276::DEBUG::2012-11-29 13:56:31,739::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-276::DEBUG::2012-11-29 13:56:31,739::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-276::DEBUG::2012-11-29 13:56:31,739::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-276::DEBUG::2012-11-29 13:56:31,740::task::957::TaskManager.Task::(_decref) Task=`e11fe16e-c72b-458d-b395-316e0fc70906`::ref 0 aborting False >Thread-278::DEBUG::2012-11-29 13:56:31,774::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-278::DEBUG::2012-11-29 13:56:31,774::task::568::TaskManager.Task::(_updateState) Task=`d5da19ce-238f-49f8-92a5-10f82372473f`::moving from state init -> state preparing >Thread-278::INFO::2012-11-29 13:56:31,775::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-278::DEBUG::2012-11-29 13:56:31,775::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323' (cwd None) >Thread-278::DEBUG::2012-11-29 13:56:31,834::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-278::DEBUG::2012-11-29 13:56:31,835::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-278::DEBUG::2012-11-29 13:56:31,835::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-278::DEBUG::2012-11-29 13:56:31,835::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-278::DEBUG::2012-11-29 13:56:31,835::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-278::DEBUG::2012-11-29 13:56:31,846::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-278::DEBUG::2012-11-29 13:56:31,847::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-278::DEBUG::2012-11-29 13:56:31,850::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-278::DEBUG::2012-11-29 13:56:31,852::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-278::DEBUG::2012-11-29 13:56:31,854::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-278::DEBUG::2012-11-29 13:56:31,856::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-278::DEBUG::2012-11-29 13:56:31,858::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-278::DEBUG::2012-11-29 13:56:31,860::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-278::DEBUG::2012-11-29 13:56:31,862::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-278::DEBUG::2012-11-29 13:56:33,865::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-278::DEBUG::2012-11-29 13:56:33,944::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2012-11-29 13:56:33,945::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2012-11-29 13:56:33,946::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2012-11-29 13:56:33,946::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2012-11-29 13:56:33,946::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2012-11-29 13:56:33,947::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-278::DEBUG::2012-11-29 13:56:33,947::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-278::DEBUG::2012-11-29 13:56:33,947::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-278::INFO::2012-11-29 13:56:33,947::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-278::DEBUG::2012-11-29 13:56:33,947::task::1151::TaskManager.Task::(prepare) Task=`d5da19ce-238f-49f8-92a5-10f82372473f`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-278::DEBUG::2012-11-29 13:56:33,948::task::568::TaskManager.Task::(_updateState) Task=`d5da19ce-238f-49f8-92a5-10f82372473f`::moving from state preparing -> state finished >Thread-278::DEBUG::2012-11-29 13:56:33,948::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-278::DEBUG::2012-11-29 13:56:33,948::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-278::DEBUG::2012-11-29 13:56:33,948::task::957::TaskManager.Task::(_decref) Task=`d5da19ce-238f-49f8-92a5-10f82372473f`::ref 0 aborting False >Thread-281::DEBUG::2012-11-29 13:56:35,200::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-281::DEBUG::2012-11-29 13:56:35,200::task::568::TaskManager.Task::(_updateState) Task=`881202d5-7438-4f9c-957a-61f102927d70`::moving from state init -> state preparing >Thread-281::INFO::2012-11-29 13:56:35,201::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-281::INFO::2012-11-29 13:56:35,201::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-281::DEBUG::2012-11-29 13:56:35,201::task::1151::TaskManager.Task::(prepare) Task=`881202d5-7438-4f9c-957a-61f102927d70`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-281::DEBUG::2012-11-29 13:56:35,201::task::568::TaskManager.Task::(_updateState) Task=`881202d5-7438-4f9c-957a-61f102927d70`::moving from state preparing -> state finished >Thread-281::DEBUG::2012-11-29 13:56:35,201::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-281::DEBUG::2012-11-29 13:56:35,202::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-281::DEBUG::2012-11-29 13:56:35,202::task::957::TaskManager.Task::(_decref) Task=`881202d5-7438-4f9c-957a-61f102927d70`::ref 0 aborting False >Thread-282::DEBUG::2012-11-29 13:56:35,232::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-282::DEBUG::2012-11-29 13:56:35,232::task::568::TaskManager.Task::(_updateState) Task=`cc89e183-3971-4b48-b645-81e02a9e470c`::moving from state init -> state preparing >Thread-282::INFO::2012-11-29 13:56:35,232::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-282::DEBUG::2012-11-29 13:56:35,236::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323' (cwd None) >Thread-282::INFO::2012-11-29 13:56:35,269::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-282::DEBUG::2012-11-29 13:56:35,269::task::1151::TaskManager.Task::(prepare) Task=`cc89e183-3971-4b48-b645-81e02a9e470c`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-282::DEBUG::2012-11-29 13:56:35,270::task::568::TaskManager.Task::(_updateState) Task=`cc89e183-3971-4b48-b645-81e02a9e470c`::moving from state preparing -> state finished >Thread-282::DEBUG::2012-11-29 13:56:35,270::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-282::DEBUG::2012-11-29 13:56:35,270::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-282::DEBUG::2012-11-29 13:56:35,270::task::957::TaskManager.Task::(_decref) Task=`cc89e183-3971-4b48-b645-81e02a9e470c`::ref 0 aborting False >Thread-283::DEBUG::2012-11-29 13:56:35,300::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-283::DEBUG::2012-11-29 13:56:35,301::task::568::TaskManager.Task::(_updateState) Task=`6d3f0ee1-a55a-46d3-bf73-003449944437`::moving from state init -> state preparing >Thread-283::INFO::2012-11-29 13:56:35,301::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', hostID=1, scsiKey='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', msdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', masterVersion=1, options=None) >Thread-283::DEBUG::2012-11-29 13:56:35,301::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`564f95d2-29a5-4251-b4f2-55363fb16096`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-283::DEBUG::2012-11-29 13:56:35,302::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-283::DEBUG::2012-11-29 13:56:35,302::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-283::DEBUG::2012-11-29 13:56:35,302::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`564f95d2-29a5-4251-b4f2-55363fb16096`::Granted request >Thread-283::INFO::2012-11-29 13:56:35,303::sp::628::Storage.StoragePool::(connect) Connect host #1 to the storage pool 1354c897-ef7d-4edf-aa4c-c1e1464d0e2b with master domain: 81105f27-0d06-428d-bedf-308ae0109fb5 (ver = 1) >Thread-283::DEBUG::2012-11-29 13:56:35,303::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:35,303::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:35,303::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:35,304::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:35,304::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:35,304::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:35,304::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-283::DEBUG::2012-11-29 13:56:35,305::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-283::DEBUG::2012-11-29 13:56:35,305::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-283::DEBUG::2012-11-29 13:56:35,305::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-283::DEBUG::2012-11-29 13:56:35,305::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-283::DEBUG::2012-11-29 13:56:35,316::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-283::DEBUG::2012-11-29 13:56:35,316::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-283::DEBUG::2012-11-29 13:56:35,318::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-283::DEBUG::2012-11-29 13:56:35,320::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-283::DEBUG::2012-11-29 13:56:35,322::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-283::DEBUG::2012-11-29 13:56:35,324::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-283::DEBUG::2012-11-29 13:56:35,326::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-283::DEBUG::2012-11-29 13:56:35,328::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-283::DEBUG::2012-11-29 13:56:35,330::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-284::DEBUG::2012-11-29 13:56:36,165::task::568::TaskManager.Task::(_updateState) Task=`fb2cffef-8ed0-49dd-8c96-30b384c01a3f`::moving from state init -> state preparing >Thread-284::INFO::2012-11-29 13:56:36,165::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-284::INFO::2012-11-29 13:56:36,165::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-284::DEBUG::2012-11-29 13:56:36,165::task::1151::TaskManager.Task::(prepare) Task=`fb2cffef-8ed0-49dd-8c96-30b384c01a3f`::finished: {} >Thread-284::DEBUG::2012-11-29 13:56:36,165::task::568::TaskManager.Task::(_updateState) Task=`fb2cffef-8ed0-49dd-8c96-30b384c01a3f`::moving from state preparing -> state finished >Thread-284::DEBUG::2012-11-29 13:56:36,165::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-284::DEBUG::2012-11-29 13:56:36,166::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-284::DEBUG::2012-11-29 13:56:36,166::task::957::TaskManager.Task::(_decref) Task=`fb2cffef-8ed0-49dd-8c96-30b384c01a3f`::ref 0 aborting False >Thread-283::DEBUG::2012-11-29 13:56:37,333::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-283::DEBUG::2012-11-29 13:56:37,374::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-283::DEBUG::2012-11-29 13:56:37,375::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,375::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,375::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,376::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,376::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,376::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,376::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-283::DEBUG::2012-11-29 13:56:37,377::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,378::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 81105f27-0d06-428d-bedf-308ae0109fb5' (cwd None) >Thread-283::DEBUG::2012-11-29 13:56:37,553::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found\n'; <rc> = 5 >Thread-283::WARNING::2012-11-29 13:56:37,554::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found'] >Thread-283::DEBUG::2012-11-29 13:56:37,555::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,571::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-283::DEBUG::2012-11-29 13:56:37,571::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-283::DEBUG::2012-11-29 13:56:37,574::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a2c503c9b50cbea17306296ccc7c2b7b63d1dc8f'] >Thread-283::DEBUG::2012-11-29 13:56:37,576::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-283::WARNING::2012-11-29 13:56:37,576::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_imageNS already registered >Thread-283::WARNING::2012-11-29 13:56:37,577::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS already registered >Thread-283::DEBUG::2012-11-29 13:56:37,577::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 81105f27-0d06-428d-bedf-308ae0109fb5 verified, version 1 >Thread-283::DEBUG::2012-11-29 13:56:37,577::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-283::DEBUG::2012-11-29 13:56:37,577::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-283::DEBUG::2012-11-29 13:56:37,580::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a2c503c9b50cbea17306296ccc7c2b7b63d1dc8f'] >Thread-291::DEBUG::2012-11-29 13:56:37,581::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-283::DEBUG::2012-11-29 13:56:37,581::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `1354c897-ef7d-4edf-aa4c-c1e1464d0e2b` started monitoring domain `81105f27-0d06-428d-bedf-308ae0109fb5` >Thread-283::DEBUG::2012-11-29 13:56:37,582::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-283::DEBUG::2012-11-29 13:56:37,585::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-283::DEBUG::2012-11-29 13:56:37,590::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-291::INFO::2012-11-29 13:56:37,603::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 1) >Thread-291::DEBUG::2012-11-29 13:56:37,604::safelease::178::SANLock::(acquireHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully acquired (id: 1) >Thread-283::DEBUG::2012-11-29 13:56:37,732::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-283::DEBUG::2012-11-29 13:56:37,732::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-283::INFO::2012-11-29 13:56:37,744::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 to /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-283::INFO::2012-11-29 13:56:37,745::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 to /rhev/data-center/1354c897-ef7d-4edf-aa4c-c1e1464d0e2b/mastersd >Thread-283::DEBUG::2012-11-29 13:56:37,745::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-283::DEBUG::2012-11-29 13:56:37,745::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-283::DEBUG::2012-11-29 13:56:37,746::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-283::DEBUG::2012-11-29 13:56:37,746::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-283::INFO::2012-11-29 13:56:37,746::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-283::DEBUG::2012-11-29 13:56:37,746::task::1151::TaskManager.Task::(prepare) Task=`6d3f0ee1-a55a-46d3-bf73-003449944437`::finished: True >Thread-283::DEBUG::2012-11-29 13:56:37,746::task::568::TaskManager.Task::(_updateState) Task=`6d3f0ee1-a55a-46d3-bf73-003449944437`::moving from state preparing -> state finished >Thread-283::DEBUG::2012-11-29 13:56:37,747::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-283::DEBUG::2012-11-29 13:56:37,747::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-283::DEBUG::2012-11-29 13:56:37,747::task::957::TaskManager.Task::(_decref) Task=`6d3f0ee1-a55a-46d3-bf73-003449944437`::ref 0 aborting False >Thread-297::DEBUG::2012-11-29 13:56:37,841::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-297::DEBUG::2012-11-29 13:56:37,842::task::568::TaskManager.Task::(_updateState) Task=`a6552396-7981-4334-af19-ce91afa2ab7c`::moving from state init -> state preparing >Thread-297::INFO::2012-11-29 13:56:37,842::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-297::INFO::2012-11-29 13:56:37,842::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-297::DEBUG::2012-11-29 13:56:37,843::task::1151::TaskManager.Task::(prepare) Task=`a6552396-7981-4334-af19-ce91afa2ab7c`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-297::DEBUG::2012-11-29 13:56:37,843::task::568::TaskManager.Task::(_updateState) Task=`a6552396-7981-4334-af19-ce91afa2ab7c`::moving from state preparing -> state finished >Thread-297::DEBUG::2012-11-29 13:56:37,843::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-297::DEBUG::2012-11-29 13:56:37,843::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-297::DEBUG::2012-11-29 13:56:37,843::task::957::TaskManager.Task::(_decref) Task=`a6552396-7981-4334-af19-ce91afa2ab7c`::ref 0 aborting False >Thread-298::DEBUG::2012-11-29 13:56:37,875::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-298::DEBUG::2012-11-29 13:56:37,876::task::568::TaskManager.Task::(_updateState) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::moving from state init -> state preparing >Thread-298::INFO::2012-11-29 13:56:37,876::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', prevID=-1, prevLVER='0', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-298::DEBUG::2012-11-29 13:56:37,876::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`b7852bb7-cd14-4eaf-9235-fd6f24dea880`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-298::DEBUG::2012-11-29 13:56:37,876::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-298::DEBUG::2012-11-29 13:56:37,877::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-298::DEBUG::2012-11-29 13:56:37,877::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`b7852bb7-cd14-4eaf-9235-fd6f24dea880`::Granted request >Thread-298::DEBUG::2012-11-29 13:56:37,877::task::794::TaskManager.Task::(resourceAcquired) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (exclusive) >Thread-298::DEBUG::2012-11-29 13:56:37,877::task::957::TaskManager.Task::(_decref) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::ref 1 aborting False >Thread-298::INFO::2012-11-29 13:56:37,878::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-298::DEBUG::2012-11-29 13:56:37,878::task::1146::TaskManager.Task::(prepare) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::Prepare: 1 jobs exist, move to acquiring >Thread-298::DEBUG::2012-11-29 13:56:37,878::task::568::TaskManager.Task::(_updateState) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::moving from state preparing -> state acquiring >Thread-298::DEBUG::2012-11-29 13:56:37,878::task::568::TaskManager.Task::(_updateState) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::moving from state acquiring -> state queued >Thread-298::DEBUG::2012-11-29 13:56:37,878::taskManager::50::TaskManager::(_queueTask) queuing task: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-298::DEBUG::2012-11-29 13:56:37,879::taskManager::56::TaskManager::(_queueTask) task queued: 762c836e-d92f-45ec-b423-46ba710e14aa >1f0ca577-c0dc-4891-bda6-c545acf15353::DEBUG::2012-11-29 13:56:37,879::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-298::DEBUG::2012-11-29 13:56:37,880::task::1148::TaskManager.Task::(prepare) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::returning >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,880::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 762c836e-d92f-45ec-b423-46ba710e14aa running: <bound method Task.commit of <storage.task.Task instance at 0x1a3dc68>> with: None >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,882::task::1159::TaskManager.Task::(commit) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::committing task: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-298::DEBUG::2012-11-29 13:56:37,882::task::957::TaskManager.Task::(_decref) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::ref 0 aborting False >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,883::task::568::TaskManager.Task::(_updateState) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::moving from state queued -> state running >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,885::task::872::TaskManager.Task::(_runJobs) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f417c375bd0>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,886::task::304::TaskManager.Task::(run) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f417c375bd0>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) callback None >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,887::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,887::misc::1027::SamplingMethod::(__call__) Got in to sampling method >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,890::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a2c503c9b50cbea17306296ccc7c2b7b63d1dc8f'] >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,890::misc::1035::SamplingMethod::(__call__) Returning last result >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:37,893::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a2c503c9b50cbea17306296ccc7c2b7b63d1dc8f'] >762c836e-d92f-45ec-b423-46ba710e14aa::INFO::2012-11-29 13:56:37,893::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 1) >Thread-300::DEBUG::2012-11-29 13:56:38,914::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-300::DEBUG::2012-11-29 13:56:38,914::task::568::TaskManager.Task::(_updateState) Task=`4e101ea7-f449-407d-84f2-26d83d1e8726`::moving from state init -> state preparing >Thread-300::INFO::2012-11-29 13:56:38,914::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-300::DEBUG::2012-11-29 13:56:38,914::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-300::DEBUG::2012-11-29 13:56:38,915::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-300::INFO::2012-11-29 13:56:38,915::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-300::DEBUG::2012-11-29 13:56:38,915::task::1151::TaskManager.Task::(prepare) Task=`4e101ea7-f449-407d-84f2-26d83d1e8726`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-300::DEBUG::2012-11-29 13:56:38,915::task::568::TaskManager.Task::(_updateState) Task=`4e101ea7-f449-407d-84f2-26d83d1e8726`::moving from state preparing -> state finished >Thread-300::DEBUG::2012-11-29 13:56:38,915::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-300::DEBUG::2012-11-29 13:56:38,915::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-300::DEBUG::2012-11-29 13:56:38,916::task::957::TaskManager.Task::(_decref) Task=`4e101ea7-f449-407d-84f2-26d83d1e8726`::ref 0 aborting False >Thread-301::DEBUG::2012-11-29 13:56:39,944::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-301::DEBUG::2012-11-29 13:56:39,945::task::568::TaskManager.Task::(_updateState) Task=`a632114d-0af5-4c71-ac73-61238ba4d4d9`::moving from state init -> state preparing >Thread-301::INFO::2012-11-29 13:56:39,945::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-301::DEBUG::2012-11-29 13:56:39,945::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-301::DEBUG::2012-11-29 13:56:39,945::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-301::INFO::2012-11-29 13:56:39,945::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-301::DEBUG::2012-11-29 13:56:39,946::task::1151::TaskManager.Task::(prepare) Task=`a632114d-0af5-4c71-ac73-61238ba4d4d9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-301::DEBUG::2012-11-29 13:56:39,946::task::568::TaskManager.Task::(_updateState) Task=`a632114d-0af5-4c71-ac73-61238ba4d4d9`::moving from state preparing -> state finished >Thread-301::DEBUG::2012-11-29 13:56:39,946::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-301::DEBUG::2012-11-29 13:56:39,946::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-301::DEBUG::2012-11-29 13:56:39,946::task::957::TaskManager.Task::(_decref) Task=`a632114d-0af5-4c71-ac73-61238ba4d4d9`::ref 0 aborting False >Thread-303::DEBUG::2012-11-29 13:56:40,974::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-303::DEBUG::2012-11-29 13:56:40,974::task::568::TaskManager.Task::(_updateState) Task=`2935bd1d-8a01-4f8f-8695-4f4470e43537`::moving from state init -> state preparing >Thread-303::INFO::2012-11-29 13:56:40,975::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-303::DEBUG::2012-11-29 13:56:40,975::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-303::DEBUG::2012-11-29 13:56:40,975::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-303::INFO::2012-11-29 13:56:40,975::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-303::DEBUG::2012-11-29 13:56:40,975::task::1151::TaskManager.Task::(prepare) Task=`2935bd1d-8a01-4f8f-8695-4f4470e43537`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-303::DEBUG::2012-11-29 13:56:40,975::task::568::TaskManager.Task::(_updateState) Task=`2935bd1d-8a01-4f8f-8695-4f4470e43537`::moving from state preparing -> state finished >Thread-303::DEBUG::2012-11-29 13:56:40,976::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-303::DEBUG::2012-11-29 13:56:40,976::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-303::DEBUG::2012-11-29 13:56:40,976::task::957::TaskManager.Task::(_decref) Task=`2935bd1d-8a01-4f8f-8695-4f4470e43537`::ref 0 aborting False >Thread-304::DEBUG::2012-11-29 13:56:42,004::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-304::DEBUG::2012-11-29 13:56:42,004::task::568::TaskManager.Task::(_updateState) Task=`c713f6ec-8552-4b48-8224-9b85bd29e144`::moving from state init -> state preparing >Thread-304::INFO::2012-11-29 13:56:42,004::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-304::DEBUG::2012-11-29 13:56:42,005::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-304::DEBUG::2012-11-29 13:56:42,005::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-304::INFO::2012-11-29 13:56:42,005::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-304::DEBUG::2012-11-29 13:56:42,005::task::1151::TaskManager.Task::(prepare) Task=`c713f6ec-8552-4b48-8224-9b85bd29e144`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-304::DEBUG::2012-11-29 13:56:42,005::task::568::TaskManager.Task::(_updateState) Task=`c713f6ec-8552-4b48-8224-9b85bd29e144`::moving from state preparing -> state finished >Thread-304::DEBUG::2012-11-29 13:56:42,005::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-304::DEBUG::2012-11-29 13:56:42,005::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-304::DEBUG::2012-11-29 13:56:42,006::task::957::TaskManager.Task::(_decref) Task=`c713f6ec-8552-4b48-8224-9b85bd29e144`::ref 0 aborting False >Thread-306::DEBUG::2012-11-29 13:56:43,035::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-306::DEBUG::2012-11-29 13:56:43,036::task::568::TaskManager.Task::(_updateState) Task=`d4638f84-d7a8-4f9a-af88-77ddaf9931a3`::moving from state init -> state preparing >Thread-306::INFO::2012-11-29 13:56:43,036::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-306::DEBUG::2012-11-29 13:56:43,036::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-306::DEBUG::2012-11-29 13:56:43,036::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-306::INFO::2012-11-29 13:56:43,036::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-306::DEBUG::2012-11-29 13:56:43,036::task::1151::TaskManager.Task::(prepare) Task=`d4638f84-d7a8-4f9a-af88-77ddaf9931a3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-306::DEBUG::2012-11-29 13:56:43,037::task::568::TaskManager.Task::(_updateState) Task=`d4638f84-d7a8-4f9a-af88-77ddaf9931a3`::moving from state preparing -> state finished >Thread-306::DEBUG::2012-11-29 13:56:43,037::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-306::DEBUG::2012-11-29 13:56:43,037::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-306::DEBUG::2012-11-29 13:56:43,037::task::957::TaskManager.Task::(_decref) Task=`d4638f84-d7a8-4f9a-af88-77ddaf9931a3`::ref 0 aborting False >Thread-307::DEBUG::2012-11-29 13:56:44,068::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-307::DEBUG::2012-11-29 13:56:44,068::task::568::TaskManager.Task::(_updateState) Task=`36921013-66df-476e-b417-815310df4e7e`::moving from state init -> state preparing >Thread-307::INFO::2012-11-29 13:56:44,068::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-307::DEBUG::2012-11-29 13:56:44,068::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-307::DEBUG::2012-11-29 13:56:44,069::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-307::INFO::2012-11-29 13:56:44,069::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-307::DEBUG::2012-11-29 13:56:44,069::task::1151::TaskManager.Task::(prepare) Task=`36921013-66df-476e-b417-815310df4e7e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-307::DEBUG::2012-11-29 13:56:44,069::task::568::TaskManager.Task::(_updateState) Task=`36921013-66df-476e-b417-815310df4e7e`::moving from state preparing -> state finished >Thread-307::DEBUG::2012-11-29 13:56:44,069::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-307::DEBUG::2012-11-29 13:56:44,069::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-307::DEBUG::2012-11-29 13:56:44,070::task::957::TaskManager.Task::(_decref) Task=`36921013-66df-476e-b417-815310df4e7e`::ref 0 aborting False >Thread-309::DEBUG::2012-11-29 13:56:45,099::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-309::DEBUG::2012-11-29 13:56:45,099::task::568::TaskManager.Task::(_updateState) Task=`d890920e-8e5b-4a19-a0f6-774337c354ef`::moving from state init -> state preparing >Thread-309::INFO::2012-11-29 13:56:45,099::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-309::DEBUG::2012-11-29 13:56:45,099::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-309::DEBUG::2012-11-29 13:56:45,100::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-309::INFO::2012-11-29 13:56:45,100::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-309::DEBUG::2012-11-29 13:56:45,100::task::1151::TaskManager.Task::(prepare) Task=`d890920e-8e5b-4a19-a0f6-774337c354ef`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-309::DEBUG::2012-11-29 13:56:45,100::task::568::TaskManager.Task::(_updateState) Task=`d890920e-8e5b-4a19-a0f6-774337c354ef`::moving from state preparing -> state finished >Thread-309::DEBUG::2012-11-29 13:56:45,100::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-309::DEBUG::2012-11-29 13:56:45,100::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-309::DEBUG::2012-11-29 13:56:45,101::task::957::TaskManager.Task::(_decref) Task=`d890920e-8e5b-4a19-a0f6-774337c354ef`::ref 0 aborting False >Thread-310::DEBUG::2012-11-29 13:56:46,129::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-310::DEBUG::2012-11-29 13:56:46,129::task::568::TaskManager.Task::(_updateState) Task=`858bb63a-54d8-45ef-9f30-5fec201a1593`::moving from state init -> state preparing >Thread-310::INFO::2012-11-29 13:56:46,129::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-310::DEBUG::2012-11-29 13:56:46,129::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-310::DEBUG::2012-11-29 13:56:46,130::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-310::INFO::2012-11-29 13:56:46,130::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-310::DEBUG::2012-11-29 13:56:46,130::task::1151::TaskManager.Task::(prepare) Task=`858bb63a-54d8-45ef-9f30-5fec201a1593`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-310::DEBUG::2012-11-29 13:56:46,130::task::568::TaskManager.Task::(_updateState) Task=`858bb63a-54d8-45ef-9f30-5fec201a1593`::moving from state preparing -> state finished >Thread-310::DEBUG::2012-11-29 13:56:46,130::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-310::DEBUG::2012-11-29 13:56:46,130::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-310::DEBUG::2012-11-29 13:56:46,131::task::957::TaskManager.Task::(_decref) Task=`858bb63a-54d8-45ef-9f30-5fec201a1593`::ref 0 aborting False >Thread-311::DEBUG::2012-11-29 13:56:46,362::task::568::TaskManager.Task::(_updateState) Task=`aa8ad70f-a3e8-41aa-b16f-9176565aae42`::moving from state init -> state preparing >Thread-311::INFO::2012-11-29 13:56:46,362::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-311::INFO::2012-11-29 13:56:46,362::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00193309783936', 'lastCheck': '8.8', 'code': 0, 'valid': True}} >Thread-311::DEBUG::2012-11-29 13:56:46,362::task::1151::TaskManager.Task::(prepare) Task=`aa8ad70f-a3e8-41aa-b16f-9176565aae42`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00193309783936', 'lastCheck': '8.8', 'code': 0, 'valid': True}} >Thread-311::DEBUG::2012-11-29 13:56:46,363::task::568::TaskManager.Task::(_updateState) Task=`aa8ad70f-a3e8-41aa-b16f-9176565aae42`::moving from state preparing -> state finished >Thread-311::DEBUG::2012-11-29 13:56:46,363::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-311::DEBUG::2012-11-29 13:56:46,363::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-311::DEBUG::2012-11-29 13:56:46,363::task::957::TaskManager.Task::(_decref) Task=`aa8ad70f-a3e8-41aa-b16f-9176565aae42`::ref 0 aborting False >Thread-313::DEBUG::2012-11-29 13:56:47,159::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-313::DEBUG::2012-11-29 13:56:47,159::task::568::TaskManager.Task::(_updateState) Task=`fece54c4-80f4-4058-9902-e6bb602a4026`::moving from state init -> state preparing >Thread-313::INFO::2012-11-29 13:56:47,159::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-313::DEBUG::2012-11-29 13:56:47,160::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-313::DEBUG::2012-11-29 13:56:47,160::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-313::INFO::2012-11-29 13:56:47,160::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-313::DEBUG::2012-11-29 13:56:47,160::task::1151::TaskManager.Task::(prepare) Task=`fece54c4-80f4-4058-9902-e6bb602a4026`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-313::DEBUG::2012-11-29 13:56:47,160::task::568::TaskManager.Task::(_updateState) Task=`fece54c4-80f4-4058-9902-e6bb602a4026`::moving from state preparing -> state finished >Thread-313::DEBUG::2012-11-29 13:56:47,160::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-313::DEBUG::2012-11-29 13:56:47,161::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-313::DEBUG::2012-11-29 13:56:47,161::task::957::TaskManager.Task::(_decref) Task=`fece54c4-80f4-4058-9902-e6bb602a4026`::ref 0 aborting False >Thread-314::DEBUG::2012-11-29 13:56:48,190::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-314::DEBUG::2012-11-29 13:56:48,190::task::568::TaskManager.Task::(_updateState) Task=`edebf590-348a-4088-a6c6-96012806c584`::moving from state init -> state preparing >Thread-314::INFO::2012-11-29 13:56:48,190::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-314::DEBUG::2012-11-29 13:56:48,190::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-314::DEBUG::2012-11-29 13:56:48,190::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-314::INFO::2012-11-29 13:56:48,191::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-314::DEBUG::2012-11-29 13:56:48,191::task::1151::TaskManager.Task::(prepare) Task=`edebf590-348a-4088-a6c6-96012806c584`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-314::DEBUG::2012-11-29 13:56:48,191::task::568::TaskManager.Task::(_updateState) Task=`edebf590-348a-4088-a6c6-96012806c584`::moving from state preparing -> state finished >Thread-314::DEBUG::2012-11-29 13:56:48,191::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-314::DEBUG::2012-11-29 13:56:48,191::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-314::DEBUG::2012-11-29 13:56:48,191::task::957::TaskManager.Task::(_decref) Task=`edebf590-348a-4088-a6c6-96012806c584`::ref 0 aborting False >Thread-316::DEBUG::2012-11-29 13:56:49,220::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-316::DEBUG::2012-11-29 13:56:49,220::task::568::TaskManager.Task::(_updateState) Task=`b799b74a-888b-47d3-974d-7822ff8eb194`::moving from state init -> state preparing >Thread-316::INFO::2012-11-29 13:56:49,220::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-316::DEBUG::2012-11-29 13:56:49,221::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-316::DEBUG::2012-11-29 13:56:49,221::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-316::INFO::2012-11-29 13:56:49,221::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-316::DEBUG::2012-11-29 13:56:49,221::task::1151::TaskManager.Task::(prepare) Task=`b799b74a-888b-47d3-974d-7822ff8eb194`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-316::DEBUG::2012-11-29 13:56:49,221::task::568::TaskManager.Task::(_updateState) Task=`b799b74a-888b-47d3-974d-7822ff8eb194`::moving from state preparing -> state finished >Thread-316::DEBUG::2012-11-29 13:56:49,221::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-316::DEBUG::2012-11-29 13:56:49,222::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-316::DEBUG::2012-11-29 13:56:49,222::task::957::TaskManager.Task::(_decref) Task=`b799b74a-888b-47d3-974d-7822ff8eb194`::ref 0 aborting False >Thread-317::DEBUG::2012-11-29 13:56:50,249::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-317::DEBUG::2012-11-29 13:56:50,250::task::568::TaskManager.Task::(_updateState) Task=`d7b50d0b-57cb-4eea-b41c-586a15376b1d`::moving from state init -> state preparing >Thread-317::INFO::2012-11-29 13:56:50,250::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-317::DEBUG::2012-11-29 13:56:50,251::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-317::DEBUG::2012-11-29 13:56:50,251::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-317::INFO::2012-11-29 13:56:50,251::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-317::DEBUG::2012-11-29 13:56:50,251::task::1151::TaskManager.Task::(prepare) Task=`d7b50d0b-57cb-4eea-b41c-586a15376b1d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-317::DEBUG::2012-11-29 13:56:50,251::task::568::TaskManager.Task::(_updateState) Task=`d7b50d0b-57cb-4eea-b41c-586a15376b1d`::moving from state preparing -> state finished >Thread-317::DEBUG::2012-11-29 13:56:50,251::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-317::DEBUG::2012-11-29 13:56:50,252::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-317::DEBUG::2012-11-29 13:56:50,252::task::957::TaskManager.Task::(_decref) Task=`d7b50d0b-57cb-4eea-b41c-586a15376b1d`::ref 0 aborting False >Thread-319::DEBUG::2012-11-29 13:56:51,281::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-319::DEBUG::2012-11-29 13:56:51,282::task::568::TaskManager.Task::(_updateState) Task=`f1cb4f26-5744-40a2-856d-febf63dc6867`::moving from state init -> state preparing >Thread-319::INFO::2012-11-29 13:56:51,282::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-319::DEBUG::2012-11-29 13:56:51,282::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-319::DEBUG::2012-11-29 13:56:51,282::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-319::INFO::2012-11-29 13:56:51,282::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-319::DEBUG::2012-11-29 13:56:51,282::task::1151::TaskManager.Task::(prepare) Task=`f1cb4f26-5744-40a2-856d-febf63dc6867`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-319::DEBUG::2012-11-29 13:56:51,283::task::568::TaskManager.Task::(_updateState) Task=`f1cb4f26-5744-40a2-856d-febf63dc6867`::moving from state preparing -> state finished >Thread-319::DEBUG::2012-11-29 13:56:51,283::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-319::DEBUG::2012-11-29 13:56:51,283::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-319::DEBUG::2012-11-29 13:56:51,283::task::957::TaskManager.Task::(_decref) Task=`f1cb4f26-5744-40a2-856d-febf63dc6867`::ref 0 aborting False >Thread-320::DEBUG::2012-11-29 13:56:52,311::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-320::DEBUG::2012-11-29 13:56:52,311::task::568::TaskManager.Task::(_updateState) Task=`f171a47c-29bd-4913-8310-edf7f9291a2a`::moving from state init -> state preparing >Thread-320::INFO::2012-11-29 13:56:52,311::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-320::DEBUG::2012-11-29 13:56:52,311::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-320::DEBUG::2012-11-29 13:56:52,312::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-320::INFO::2012-11-29 13:56:52,312::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-320::DEBUG::2012-11-29 13:56:52,312::task::1151::TaskManager.Task::(prepare) Task=`f171a47c-29bd-4913-8310-edf7f9291a2a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-320::DEBUG::2012-11-29 13:56:52,312::task::568::TaskManager.Task::(_updateState) Task=`f171a47c-29bd-4913-8310-edf7f9291a2a`::moving from state preparing -> state finished >Thread-320::DEBUG::2012-11-29 13:56:52,312::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-320::DEBUG::2012-11-29 13:56:52,312::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-320::DEBUG::2012-11-29 13:56:52,313::task::957::TaskManager.Task::(_decref) Task=`f171a47c-29bd-4913-8310-edf7f9291a2a`::ref 0 aborting False >Thread-322::DEBUG::2012-11-29 13:56:53,354::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-322::DEBUG::2012-11-29 13:56:53,354::task::568::TaskManager.Task::(_updateState) Task=`f079e1e9-c29c-45ae-85cd-57f77a4f3a59`::moving from state init -> state preparing >Thread-322::INFO::2012-11-29 13:56:53,354::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-322::DEBUG::2012-11-29 13:56:53,355::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-322::DEBUG::2012-11-29 13:56:53,355::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-322::INFO::2012-11-29 13:56:53,355::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-322::DEBUG::2012-11-29 13:56:53,355::task::1151::TaskManager.Task::(prepare) Task=`f079e1e9-c29c-45ae-85cd-57f77a4f3a59`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-322::DEBUG::2012-11-29 13:56:53,355::task::568::TaskManager.Task::(_updateState) Task=`f079e1e9-c29c-45ae-85cd-57f77a4f3a59`::moving from state preparing -> state finished >Thread-322::DEBUG::2012-11-29 13:56:53,355::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-322::DEBUG::2012-11-29 13:56:53,356::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-322::DEBUG::2012-11-29 13:56:53,356::task::957::TaskManager.Task::(_decref) Task=`f079e1e9-c29c-45ae-85cd-57f77a4f3a59`::ref 0 aborting False >Thread-323::DEBUG::2012-11-29 13:56:54,384::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-323::DEBUG::2012-11-29 13:56:54,384::task::568::TaskManager.Task::(_updateState) Task=`915ed90d-7c6d-4e09-9ee3-d259005e8265`::moving from state init -> state preparing >Thread-323::INFO::2012-11-29 13:56:54,384::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-323::DEBUG::2012-11-29 13:56:54,384::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-323::DEBUG::2012-11-29 13:56:54,384::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-323::INFO::2012-11-29 13:56:54,385::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-323::DEBUG::2012-11-29 13:56:54,385::task::1151::TaskManager.Task::(prepare) Task=`915ed90d-7c6d-4e09-9ee3-d259005e8265`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-323::DEBUG::2012-11-29 13:56:54,385::task::568::TaskManager.Task::(_updateState) Task=`915ed90d-7c6d-4e09-9ee3-d259005e8265`::moving from state preparing -> state finished >Thread-323::DEBUG::2012-11-29 13:56:54,385::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-323::DEBUG::2012-11-29 13:56:54,385::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-323::DEBUG::2012-11-29 13:56:54,385::task::957::TaskManager.Task::(_decref) Task=`915ed90d-7c6d-4e09-9ee3-d259005e8265`::ref 0 aborting False >Thread-325::DEBUG::2012-11-29 13:56:55,414::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-325::DEBUG::2012-11-29 13:56:55,415::task::568::TaskManager.Task::(_updateState) Task=`f9780b16-010c-44f5-aac1-e9bf3bd803c2`::moving from state init -> state preparing >Thread-325::INFO::2012-11-29 13:56:55,415::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-325::DEBUG::2012-11-29 13:56:55,415::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-325::DEBUG::2012-11-29 13:56:55,415::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-325::INFO::2012-11-29 13:56:55,415::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-325::DEBUG::2012-11-29 13:56:55,415::task::1151::TaskManager.Task::(prepare) Task=`f9780b16-010c-44f5-aac1-e9bf3bd803c2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-325::DEBUG::2012-11-29 13:56:55,416::task::568::TaskManager.Task::(_updateState) Task=`f9780b16-010c-44f5-aac1-e9bf3bd803c2`::moving from state preparing -> state finished >Thread-325::DEBUG::2012-11-29 13:56:55,416::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-325::DEBUG::2012-11-29 13:56:55,416::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-325::DEBUG::2012-11-29 13:56:55,416::task::957::TaskManager.Task::(_decref) Task=`f9780b16-010c-44f5-aac1-e9bf3bd803c2`::ref 0 aborting False >Thread-326::DEBUG::2012-11-29 13:56:56,443::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-326::DEBUG::2012-11-29 13:56:56,443::task::568::TaskManager.Task::(_updateState) Task=`58223d37-33d0-4aaa-bbe9-489fa350959a`::moving from state init -> state preparing >Thread-326::INFO::2012-11-29 13:56:56,444::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-326::DEBUG::2012-11-29 13:56:56,444::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-326::DEBUG::2012-11-29 13:56:56,444::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-326::INFO::2012-11-29 13:56:56,444::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-326::DEBUG::2012-11-29 13:56:56,444::task::1151::TaskManager.Task::(prepare) Task=`58223d37-33d0-4aaa-bbe9-489fa350959a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-326::DEBUG::2012-11-29 13:56:56,444::task::568::TaskManager.Task::(_updateState) Task=`58223d37-33d0-4aaa-bbe9-489fa350959a`::moving from state preparing -> state finished >Thread-326::DEBUG::2012-11-29 13:56:56,445::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-326::DEBUG::2012-11-29 13:56:56,445::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-326::DEBUG::2012-11-29 13:56:56,445::task::957::TaskManager.Task::(_decref) Task=`58223d37-33d0-4aaa-bbe9-489fa350959a`::ref 0 aborting False >Thread-327::DEBUG::2012-11-29 13:56:56,559::task::568::TaskManager.Task::(_updateState) Task=`94a5e9ea-a111-4c0b-99ad-26b6923f750c`::moving from state init -> state preparing >Thread-327::INFO::2012-11-29 13:56:56,560::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-327::INFO::2012-11-29 13:56:56,560::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00193309783936', 'lastCheck': '19.0', 'code': 0, 'valid': True}} >Thread-327::DEBUG::2012-11-29 13:56:56,560::task::1151::TaskManager.Task::(prepare) Task=`94a5e9ea-a111-4c0b-99ad-26b6923f750c`::finished: {'81105f27-0d06-428d-bedf-308ae0109fb5': {'delay': '0.00193309783936', 'lastCheck': '19.0', 'code': 0, 'valid': True}} >Thread-327::DEBUG::2012-11-29 13:56:56,560::task::568::TaskManager.Task::(_updateState) Task=`94a5e9ea-a111-4c0b-99ad-26b6923f750c`::moving from state preparing -> state finished >Thread-327::DEBUG::2012-11-29 13:56:56,560::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-327::DEBUG::2012-11-29 13:56:56,560::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-327::DEBUG::2012-11-29 13:56:56,561::task::957::TaskManager.Task::(_decref) Task=`94a5e9ea-a111-4c0b-99ad-26b6923f750c`::ref 0 aborting False >Thread-329::DEBUG::2012-11-29 13:56:57,472::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-329::DEBUG::2012-11-29 13:56:57,472::task::568::TaskManager.Task::(_updateState) Task=`8b1f5582-f21b-4b4d-873c-72b74a0af174`::moving from state init -> state preparing >Thread-329::INFO::2012-11-29 13:56:57,473::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-329::DEBUG::2012-11-29 13:56:57,473::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-329::DEBUG::2012-11-29 13:56:57,473::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-329::INFO::2012-11-29 13:56:57,473::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-329::DEBUG::2012-11-29 13:56:57,473::task::1151::TaskManager.Task::(prepare) Task=`8b1f5582-f21b-4b4d-873c-72b74a0af174`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-329::DEBUG::2012-11-29 13:56:57,473::task::568::TaskManager.Task::(_updateState) Task=`8b1f5582-f21b-4b4d-873c-72b74a0af174`::moving from state preparing -> state finished >Thread-329::DEBUG::2012-11-29 13:56:57,474::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-329::DEBUG::2012-11-29 13:56:57,474::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-329::DEBUG::2012-11-29 13:56:57,474::task::957::TaskManager.Task::(_decref) Task=`8b1f5582-f21b-4b4d-873c-72b74a0af174`::ref 0 aborting False >Thread-330::DEBUG::2012-11-29 13:56:58,502::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-330::DEBUG::2012-11-29 13:56:58,502::task::568::TaskManager.Task::(_updateState) Task=`0660877e-1ad8-47af-9844-93cff1c6ee6d`::moving from state init -> state preparing >Thread-330::INFO::2012-11-29 13:56:58,502::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-330::DEBUG::2012-11-29 13:56:58,503::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-330::DEBUG::2012-11-29 13:56:58,503::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-330::INFO::2012-11-29 13:56:58,503::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-330::DEBUG::2012-11-29 13:56:58,503::task::1151::TaskManager.Task::(prepare) Task=`0660877e-1ad8-47af-9844-93cff1c6ee6d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-330::DEBUG::2012-11-29 13:56:58,503::task::568::TaskManager.Task::(_updateState) Task=`0660877e-1ad8-47af-9844-93cff1c6ee6d`::moving from state preparing -> state finished >Thread-330::DEBUG::2012-11-29 13:56:58,503::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-330::DEBUG::2012-11-29 13:56:58,504::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-330::DEBUG::2012-11-29 13:56:58,504::task::957::TaskManager.Task::(_decref) Task=`0660877e-1ad8-47af-9844-93cff1c6ee6d`::ref 0 aborting False >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,896::safelease::178::SANLock::(acquireHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully acquired (id: 1) >762c836e-d92f-45ec-b423-46ba710e14aa::INFO::2012-11-29 13:56:58,896::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 1) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,931::safelease::235::SANLock::(acquire) Cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully acquired (id: 1) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,931::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,934::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a2c503c9b50cbea17306296ccc7c2b7b63d1dc8f'] >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,934::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,935::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,935::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4658b9bd3940babaa604334e7d4333935de14003'] >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,938::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,938::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`3686bb28-92f9-46c5-bad1-a806eafad6d5`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,938::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,939::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,939::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`3686bb28-92f9-46c5-bad1-a806eafad6d5`::Granted request >762c836e-d92f-45ec-b423-46ba710e14aa::INFO::2012-11-29 13:56:58,939::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `81105f27-0d06-428d-bedf-308ae0109fb5` >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,939::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`9997701b-f9f7-4fbe-a651-b6a277e1fecf`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,940::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'exclusive' >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,940::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'exclusive' (1 active user) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,940::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`9997701b-f9f7-4fbe-a651-b6a277e1fecf`::Granted request >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,940::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:58,941::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 81105f27-0d06-428d-bedf-308ae0109fb5' (cwd None) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,094::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found\n'; <rc> = 5 >762c836e-d92f-45ec-b423-46ba710e14aa::WARNING::2012-11-29 13:56:59,095::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found'] >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,096::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,108::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,109::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,112::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=81105f27-0d06-428d-bedf-308ae0109fb5:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4658b9bd3940babaa604334e7d4333935de14003'] >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,113::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >762c836e-d92f-45ec-b423-46ba710e14aa::WARNING::2012-11-29 13:56:59,113::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_imageNS already registered >762c836e-d92f-45ec-b423-46ba710e14aa::WARNING::2012-11-29 13:56:59,113::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS already registered >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,114::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,114::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,114::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,114::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,115::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,115::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,115::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,115::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,115::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,116::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,116::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,117::sp::309::Storage.StoragePool::(startSpm) ended. >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,117::task::568::TaskManager.Task::(_updateState) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::moving from state running -> state finished >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,117::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,118::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,118::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,118::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,118::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,118::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,119::task::880::TaskManager.Task::(_runJobs) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::Task.run: exit - success: result >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,119::task::957::TaskManager.Task::(_decref) Task=`762c836e-d92f-45ec-b423-46ba710e14aa`::ref 0 aborting False >762c836e-d92f-45ec-b423-46ba710e14aa::DEBUG::2012-11-29 13:56:59,119::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-337::DEBUG::2012-11-29 13:56:59,531::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-337::DEBUG::2012-11-29 13:56:59,532::task::568::TaskManager.Task::(_updateState) Task=`016f52dd-c37e-4457-8ae4-45c4ad8a1b3d`::moving from state init -> state preparing >Thread-337::INFO::2012-11-29 13:56:59,532::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-337::DEBUG::2012-11-29 13:56:59,532::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-337::DEBUG::2012-11-29 13:56:59,532::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'} >Thread-337::INFO::2012-11-29 13:56:59,532::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-337::DEBUG::2012-11-29 13:56:59,532::task::1151::TaskManager.Task::(prepare) Task=`016f52dd-c37e-4457-8ae4-45c4ad8a1b3d`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '762c836e-d92f-45ec-b423-46ba710e14aa'}} >Thread-337::DEBUG::2012-11-29 13:56:59,533::task::568::TaskManager.Task::(_updateState) Task=`016f52dd-c37e-4457-8ae4-45c4ad8a1b3d`::moving from state preparing -> state finished >Thread-337::DEBUG::2012-11-29 13:56:59,533::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-337::DEBUG::2012-11-29 13:56:59,533::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-337::DEBUG::2012-11-29 13:56:59,533::task::957::TaskManager.Task::(_decref) Task=`016f52dd-c37e-4457-8ae4-45c4ad8a1b3d`::ref 0 aborting False >Thread-338::DEBUG::2012-11-29 13:56:59,557::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-338::DEBUG::2012-11-29 13:56:59,557::task::568::TaskManager.Task::(_updateState) Task=`f02fb925-d60b-4eee-bac7-5f6677d54fbc`::moving from state init -> state preparing >Thread-338::INFO::2012-11-29 13:56:59,558::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-338::INFO::2012-11-29 13:56:59,558::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-338::DEBUG::2012-11-29 13:56:59,558::task::1151::TaskManager.Task::(prepare) Task=`f02fb925-d60b-4eee-bac7-5f6677d54fbc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-338::DEBUG::2012-11-29 13:56:59,558::task::568::TaskManager.Task::(_updateState) Task=`f02fb925-d60b-4eee-bac7-5f6677d54fbc`::moving from state preparing -> state finished >Thread-338::DEBUG::2012-11-29 13:56:59,558::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-338::DEBUG::2012-11-29 13:56:59,558::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-338::DEBUG::2012-11-29 13:56:59,559::task::957::TaskManager.Task::(_decref) Task=`f02fb925-d60b-4eee-bac7-5f6677d54fbc`::ref 0 aborting False >Thread-339::DEBUG::2012-11-29 13:56:59,585::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-339::DEBUG::2012-11-29 13:56:59,585::task::568::TaskManager.Task::(_updateState) Task=`b9f3bffb-45e4-42dd-9a9f-46bd65a70138`::moving from state init -> state preparing >Thread-339::INFO::2012-11-29 13:56:59,585::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='762c836e-d92f-45ec-b423-46ba710e14aa', spUUID=None, options=None) >Thread-339::DEBUG::2012-11-29 13:56:59,585::taskManager::161::TaskManager::(clearTask) Entry. taskID: 762c836e-d92f-45ec-b423-46ba710e14aa >Thread-339::DEBUG::2012-11-29 13:56:59,585::taskManager::166::TaskManager::(clearTask) Return. >Thread-339::INFO::2012-11-29 13:56:59,586::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-339::DEBUG::2012-11-29 13:56:59,586::task::1151::TaskManager.Task::(prepare) Task=`b9f3bffb-45e4-42dd-9a9f-46bd65a70138`::finished: None >Thread-339::DEBUG::2012-11-29 13:56:59,586::task::568::TaskManager.Task::(_updateState) Task=`b9f3bffb-45e4-42dd-9a9f-46bd65a70138`::moving from state preparing -> state finished >Thread-339::DEBUG::2012-11-29 13:56:59,586::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-339::DEBUG::2012-11-29 13:56:59,586::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-339::DEBUG::2012-11-29 13:56:59,586::task::957::TaskManager.Task::(_decref) Task=`b9f3bffb-45e4-42dd-9a9f-46bd65a70138`::ref 0 aborting False >Thread-340::DEBUG::2012-11-29 13:56:59,624::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-340::DEBUG::2012-11-29 13:56:59,624::task::568::TaskManager.Task::(_updateState) Task=`bb62eafe-6ce3-4bcc-96d5-1674fdc2abc9`::moving from state init -> state preparing >Thread-340::INFO::2012-11-29 13:56:59,624::logUtils::37::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', hostID=1, scsiKey='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', options=None) >Thread-340::INFO::2012-11-29 13:56:59,624::hsm::1035::Storage.HSM::(destroyStoragePool) spUUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b >Thread-340::DEBUG::2012-11-29 13:56:59,625::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`7904cd8b-5998-4bc5-b08a-49e5938a07c7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-340::DEBUG::2012-11-29 13:56:59,625::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-340::DEBUG::2012-11-29 13:56:59,625::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-340::DEBUG::2012-11-29 13:56:59,625::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`7904cd8b-5998-4bc5-b08a-49e5938a07c7`::Granted request >Thread-340::DEBUG::2012-11-29 13:56:59,626::task::794::TaskManager.Task::(resourceAcquired) Task=`bb62eafe-6ce3-4bcc-96d5-1674fdc2abc9`::_resourcesAcquired: Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b (exclusive) >Thread-340::DEBUG::2012-11-29 13:56:59,626::task::957::TaskManager.Task::(_decref) Task=`bb62eafe-6ce3-4bcc-96d5-1674fdc2abc9`::ref 1 aborting False >Thread-340::DEBUG::2012-11-29 13:56:59,626::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`283ba30c-0c87-4ec2-b947-4a8f069a53ba`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-340::DEBUG::2012-11-29 13:56:59,626::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'exclusive' >Thread-340::DEBUG::2012-11-29 13:56:59,626::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'exclusive' (1 active user) >Thread-340::DEBUG::2012-11-29 13:56:59,627::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`283ba30c-0c87-4ec2-b947-4a8f069a53ba`::Granted request >Thread-340::DEBUG::2012-11-29 13:56:59,627::task::794::TaskManager.Task::(resourceAcquired) Task=`bb62eafe-6ce3-4bcc-96d5-1674fdc2abc9`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (exclusive) >Thread-340::DEBUG::2012-11-29 13:56:59,627::task::957::TaskManager.Task::(_decref) Task=`bb62eafe-6ce3-4bcc-96d5-1674fdc2abc9`::ref 1 aborting False >Thread-340::WARNING::2012-11-29 13:56:59,627::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `81105f27-0d06-428d-bedf-308ae0109fb5` >Thread-340::DEBUG::2012-11-29 13:56:59,628::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-340::DEBUG::2012-11-29 13:56:59,628::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-340::DEBUG::2012-11-29 13:56:59,628::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=878eb58df372fdd49493998cdf5cfa8bc7b1101f'] >Thread-340::DEBUG::2012-11-29 13:56:59,631::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-340::DEBUG::2012-11-29 13:56:59,631::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-340::DEBUG::2012-11-29 13:56:59,632::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`f127e385-cf0e-44aa-84a4-4a7934428e2a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-340::DEBUG::2012-11-29 13:56:59,632::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' for lock type 'exclusive' >Thread-340::DEBUG::2012-11-29 13:56:59,632::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free. Now locking as 'exclusive' (1 active user) >Thread-340::DEBUG::2012-11-29 13:56:59,632::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b`ReqID=`f127e385-cf0e-44aa-84a4-4a7934428e2a`::Granted request >Thread-340::DEBUG::2012-11-29 13:56:59,633::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-340::DEBUG::2012-11-29 13:56:59,633::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-340::DEBUG::2012-11-29 13:56:59,633::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-340::DEBUG::2012-11-29 13:56:59,633::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-340::DEBUG::2012-11-29 13:56:59,636::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,637::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,639::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,640::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,642::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,643::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,645::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,647::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,648::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,650::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,651::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,653::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,654::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,656::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,657::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,659::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,660::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,662::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,663::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,665::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,666::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,668::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,669::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,671::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,672::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,674::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,676::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,677::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,679::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,680::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,682::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,683::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,685::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,686::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,688::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,689::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,691::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,692::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,694::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,695::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,697::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,698::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,700::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,701::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >Thread-340::DEBUG::2012-11-29 13:56:59,702::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-340::DEBUG::2012-11-29 13:56:59,702::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-340::DEBUG::2012-11-29 13:56:59,702::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=54873d74d73982170f6ec2ae10e85b8898522a9b'] >Thread-340::DEBUG::2012-11-29 13:56:59,705::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-340::INFO::2012-11-29 13:56:59,705::safelease::239::SANLock::(release) Releasing cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-340::DEBUG::2012-11-29 13:56:59,707::safelease::250::SANLock::(release) Cluster lock for domain 81105f27-0d06-428d-bedf-308ae0109fb5 successfully released >Thread-340::DEBUG::2012-11-29 13:56:59,707::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-340::DEBUG::2012-11-29 13:56:59,708::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-340::DEBUG::2012-11-29 13:56:59,710::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=54873d74d73982170f6ec2ae10e85b8898522a9b'] >Thread-291::DEBUG::2012-11-29 13:56:59,711::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-291::INFO::2012-11-29 13:56:59,711::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 (id: 1) >Thread-291::DEBUG::2012-11-29 13:57:01,712::safelease::193::SANLock::(releaseHostId) Host id for domain 81105f27-0d06-428d-bedf-308ae0109fb5 released successfully (id: 1) >Thread-340::DEBUG::2012-11-29 13:57:01,712::sp::1558::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `1354c897-ef7d-4edf-aa4c-c1e1464d0e2b` stopped monitoring domain `81105f27-0d06-428d-bedf-308ae0109fb5` >Thread-340::DEBUG::2012-11-29 13:57:01,712::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-340::DEBUG::2012-11-29 13:57:01,712::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `81105f27-0d06-428d-bedf-308ae0109fb5` is done >Thread-340::DEBUG::2012-11-29 13:57:01,715::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Master', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=54873d74d73982170f6ec2ae10e85b8898522a9b'] >Thread-340::DEBUG::2012-11-29 13:57:01,715::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-340::DEBUG::2012-11-29 13:57:01,715::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-340::DEBUG::2012-11-29 13:57:01,715::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-340::DEBUG::2012-11-29 13:57:01,715::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-340::DEBUG::2012-11-29 13:57:01,716::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3ed15eac66951f98207bd8b2bb4a06522c2e1362'] >Thread-340::DEBUG::2012-11-29 13:57:01,719::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-340::DEBUG::2012-11-29 13:57:01,719::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-340::DEBUG::2012-11-29 13:57:01,719::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-340::DEBUG::2012-11-29 13:57:01,722::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3ed15eac66951f98207bd8b2bb4a06522c2e1362'] >Thread-340::DEBUG::2012-11-29 13:57:01,722::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-340::INFO::2012-11-29 13:57:01,722::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 1354c897-ef7d-4edf-aa4c-c1e1464d0e2b >Thread-340::INFO::2012-11-29 13:57:01,723::logUtils::39::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True >Thread-340::DEBUG::2012-11-29 13:57:01,723::task::1151::TaskManager.Task::(prepare) Task=`bb62eafe-6ce3-4bcc-96d5-1674fdc2abc9`::finished: True >Thread-340::DEBUG::2012-11-29 13:57:01,723::task::568::TaskManager.Task::(_updateState) Task=`bb62eafe-6ce3-4bcc-96d5-1674fdc2abc9`::moving from state preparing -> state finished >Thread-340::DEBUG::2012-11-29 13:57:01,723::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>, 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b': < ResourceRef 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', isValid: 'True' obj: 'None'>} >Thread-340::DEBUG::2012-11-29 13:57:01,723::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-340::DEBUG::2012-11-29 13:57:01,724::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-340::DEBUG::2012-11-29 13:57:01,724::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-340::DEBUG::2012-11-29 13:57:01,724::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-340::DEBUG::2012-11-29 13:57:01,724::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-340::DEBUG::2012-11-29 13:57:01,724::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' >Thread-340::DEBUG::2012-11-29 13:57:01,725::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' (0 active users) >Thread-340::DEBUG::2012-11-29 13:57:01,725::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b' is free, finding out if anyone is waiting for it. >Thread-340::DEBUG::2012-11-29 13:57:01,725::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', Clearing records. >Thread-340::DEBUG::2012-11-29 13:57:01,725::task::957::TaskManager.Task::(_decref) Task=`bb62eafe-6ce3-4bcc-96d5-1674fdc2abc9`::ref 0 aborting False >Thread-342::DEBUG::2012-11-29 13:57:01,774::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-342::DEBUG::2012-11-29 13:57:01,775::task::568::TaskManager.Task::(_updateState) Task=`c4a712d3-4c35-4931-9e8e-bb4abe37f470`::moving from state init -> state preparing >Thread-342::INFO::2012-11-29 13:57:01,775::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-342::DEBUG::2012-11-29 13:57:01,775::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323' (cwd None) >Thread-342::DEBUG::2012-11-29 13:57:01,808::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-342::DEBUG::2012-11-29 13:57:01,809::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-342::DEBUG::2012-11-29 13:57:01,809::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-342::DEBUG::2012-11-29 13:57:01,809::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-342::DEBUG::2012-11-29 13:57:01,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-342::DEBUG::2012-11-29 13:57:01,820::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-342::DEBUG::2012-11-29 13:57:01,820::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-342::DEBUG::2012-11-29 13:57:01,822::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-342::DEBUG::2012-11-29 13:57:01,824::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-342::DEBUG::2012-11-29 13:57:01,826::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-342::DEBUG::2012-11-29 13:57:01,828::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-342::DEBUG::2012-11-29 13:57:01,830::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-342::DEBUG::2012-11-29 13:57:01,832::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-342::DEBUG::2012-11-29 13:57:01,834::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-342::DEBUG::2012-11-29 13:57:03,837::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-342::DEBUG::2012-11-29 13:57:03,872::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-342::DEBUG::2012-11-29 13:57:03,873::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-342::DEBUG::2012-11-29 13:57:03,873::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-342::DEBUG::2012-11-29 13:57:03,873::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-342::DEBUG::2012-11-29 13:57:03,873::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-342::DEBUG::2012-11-29 13:57:03,874::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-342::DEBUG::2012-11-29 13:57:03,874::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-342::DEBUG::2012-11-29 13:57:03,874::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-342::INFO::2012-11-29 13:57:03,874::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-342::DEBUG::2012-11-29 13:57:03,875::task::1151::TaskManager.Task::(prepare) Task=`c4a712d3-4c35-4931-9e8e-bb4abe37f470`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-342::DEBUG::2012-11-29 13:57:03,875::task::568::TaskManager.Task::(_updateState) Task=`c4a712d3-4c35-4931-9e8e-bb4abe37f470`::moving from state preparing -> state finished >Thread-342::DEBUG::2012-11-29 13:57:03,875::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-342::DEBUG::2012-11-29 13:57:03,875::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-342::DEBUG::2012-11-29 13:57:03,875::task::957::TaskManager.Task::(_decref) Task=`c4a712d3-4c35-4931-9e8e-bb4abe37f470`::ref 0 aborting False >Thread-344::DEBUG::2012-11-29 13:57:03,932::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-344::DEBUG::2012-11-29 13:57:03,933::task::568::TaskManager.Task::(_updateState) Task=`5f133306-d757-452a-b98d-7f62502c4469`::moving from state init -> state preparing >Thread-344::INFO::2012-11-29 13:57:03,933::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', hostID=1, scsiKey='1354c897-ef7d-4edf-aa4c-c1e1464d0e2b', remove=False, options=None) >Thread-344::WARNING::2012-11-29 13:57:03,933::hsm::1001::Storage.HSM::(disconnectStoragePool) disconnect sp: 1354c897-ef7d-4edf-aa4c-c1e1464d0e2b failed. Known pools {} >Thread-344::INFO::2012-11-29 13:57:03,933::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-344::DEBUG::2012-11-29 13:57:03,933::task::1151::TaskManager.Task::(prepare) Task=`5f133306-d757-452a-b98d-7f62502c4469`::finished: None >Thread-344::DEBUG::2012-11-29 13:57:03,934::task::568::TaskManager.Task::(_updateState) Task=`5f133306-d757-452a-b98d-7f62502c4469`::moving from state preparing -> state finished >Thread-344::DEBUG::2012-11-29 13:57:03,934::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-344::DEBUG::2012-11-29 13:57:03,934::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-344::DEBUG::2012-11-29 13:57:03,934::task::957::TaskManager.Task::(_decref) Task=`5f133306-d757-452a-b98d-7f62502c4469`::ref 0 aborting False >Thread-346::DEBUG::2012-11-29 13:57:05,178::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-346::DEBUG::2012-11-29 13:57:05,178::task::568::TaskManager.Task::(_updateState) Task=`1666a513-f7db-4be9-9733-8648623e2e93`::moving from state init -> state preparing >Thread-346::INFO::2012-11-29 13:57:05,179::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-346::INFO::2012-11-29 13:57:05,179::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-346::DEBUG::2012-11-29 13:57:05,179::task::1151::TaskManager.Task::(prepare) Task=`1666a513-f7db-4be9-9733-8648623e2e93`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-346::DEBUG::2012-11-29 13:57:05,179::task::568::TaskManager.Task::(_updateState) Task=`1666a513-f7db-4be9-9733-8648623e2e93`::moving from state preparing -> state finished >Thread-346::DEBUG::2012-11-29 13:57:05,179::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-346::DEBUG::2012-11-29 13:57:05,179::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-346::DEBUG::2012-11-29 13:57:05,180::task::957::TaskManager.Task::(_decref) Task=`1666a513-f7db-4be9-9733-8648623e2e93`::ref 0 aborting False >Thread-347::DEBUG::2012-11-29 13:57:05,209::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-347::DEBUG::2012-11-29 13:57:05,209::task::568::TaskManager.Task::(_updateState) Task=`641ddca7-d0e9-4df5-afd8-a393bb0ae2dc`::moving from state init -> state preparing >Thread-347::INFO::2012-11-29 13:57:05,210::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-347::DEBUG::2012-11-29 13:57:05,212::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323' (cwd None) >Thread-347::INFO::2012-11-29 13:57:05,238::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-347::DEBUG::2012-11-29 13:57:05,238::task::1151::TaskManager.Task::(prepare) Task=`641ddca7-d0e9-4df5-afd8-a393bb0ae2dc`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-347::DEBUG::2012-11-29 13:57:05,239::task::568::TaskManager.Task::(_updateState) Task=`641ddca7-d0e9-4df5-afd8-a393bb0ae2dc`::moving from state preparing -> state finished >Thread-347::DEBUG::2012-11-29 13:57:05,239::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-347::DEBUG::2012-11-29 13:57:05,239::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-347::DEBUG::2012-11-29 13:57:05,239::task::957::TaskManager.Task::(_decref) Task=`641ddca7-d0e9-4df5-afd8-a393bb0ae2dc`::ref 0 aborting False >Thread-348::DEBUG::2012-11-29 13:57:05,268::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-348::DEBUG::2012-11-29 13:57:05,269::task::568::TaskManager.Task::(_updateState) Task=`d80ce77b-c669-49b0-b4ef-6e59691a6ef1`::moving from state init -> state preparing >Thread-348::INFO::2012-11-29 13:57:05,269::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='81105f27-0d06-428d-bedf-308ae0109fb5', autoDetach=False, options=None) >Thread-348::DEBUG::2012-11-29 13:57:05,269::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-348::DEBUG::2012-11-29 13:57:05,269::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-348::DEBUG::2012-11-29 13:57:05,270::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-348::DEBUG::2012-11-29 13:57:05,281::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-348::DEBUG::2012-11-29 13:57:05,281::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:05,283::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:05,285::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:05,287::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:05,289::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:05,291::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:05,293::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:05,295::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-349::DEBUG::2012-11-29 13:57:06,758::task::568::TaskManager.Task::(_updateState) Task=`2ac54019-37ef-4578-ad0a-7f667994537d`::moving from state init -> state preparing >Thread-349::INFO::2012-11-29 13:57:06,758::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-349::INFO::2012-11-29 13:57:06,758::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-349::DEBUG::2012-11-29 13:57:06,758::task::1151::TaskManager.Task::(prepare) Task=`2ac54019-37ef-4578-ad0a-7f667994537d`::finished: {} >Thread-349::DEBUG::2012-11-29 13:57:06,758::task::568::TaskManager.Task::(_updateState) Task=`2ac54019-37ef-4578-ad0a-7f667994537d`::moving from state preparing -> state finished >Thread-349::DEBUG::2012-11-29 13:57:06,759::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-349::DEBUG::2012-11-29 13:57:06,759::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-349::DEBUG::2012-11-29 13:57:06,759::task::957::TaskManager.Task::(_decref) Task=`2ac54019-37ef-4578-ad0a-7f667994537d`::ref 0 aborting False >Thread-348::DEBUG::2012-11-29 13:57:07,298::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-348::DEBUG::2012-11-29 13:57:07,329::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-348::DEBUG::2012-11-29 13:57:07,330::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`b06a9f8f-6719-438b-a537-41fa08c95d67`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-348::DEBUG::2012-11-29 13:57:07,330::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' for lock type 'exclusive' >Thread-348::DEBUG::2012-11-29 13:57:07,330::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free. Now locking as 'exclusive' (1 active user) >Thread-348::DEBUG::2012-11-29 13:57:07,330::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.81105f27-0d06-428d-bedf-308ae0109fb5`ReqID=`b06a9f8f-6719-438b-a537-41fa08c95d67`::Granted request >Thread-348::DEBUG::2012-11-29 13:57:07,331::task::794::TaskManager.Task::(resourceAcquired) Task=`d80ce77b-c669-49b0-b4ef-6e59691a6ef1`::_resourcesAcquired: Storage.81105f27-0d06-428d-bedf-308ae0109fb5 (exclusive) >Thread-348::DEBUG::2012-11-29 13:57:07,331::task::957::TaskManager.Task::(_decref) Task=`d80ce77b-c669-49b0-b4ef-6e59691a6ef1`::ref 1 aborting False >Thread-348::DEBUG::2012-11-29 13:57:07,335::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3ed15eac66951f98207bd8b2bb4a06522c2e1362'] >Thread-348::DEBUG::2012-11-29 13:57:07,335::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-348::DEBUG::2012-11-29 13:57:07,336::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-348::DEBUG::2012-11-29 13:57:07,336::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-348::DEBUG::2012-11-29 13:57:07,336::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-348::DEBUG::2012-11-29 13:57:07,336::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-348::DEBUG::2012-11-29 13:57:07,347::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-348::DEBUG::2012-11-29 13:57:07,347::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:07,348::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:07,350::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:07,352::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:07,354::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:07,356::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:07,358::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-348::DEBUG::2012-11-29 13:57:07,360::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-348::DEBUG::2012-11-29 13:57:09,363::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-348::DEBUG::2012-11-29 13:57:09,432::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-348::DEBUG::2012-11-29 13:57:09,433::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-348::DEBUG::2012-11-29 13:57:09,433::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-348::DEBUG::2012-11-29 13:57:09,433::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-348::DEBUG::2012-11-29 13:57:09,433::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-348::DEBUG::2012-11-29 13:57:09,434::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-348::DEBUG::2012-11-29 13:57:09,434::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-348::DEBUG::2012-11-29 13:57:09,434::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-348::DEBUG::2012-11-29 13:57:09,434::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-348::DEBUG::2012-11-29 13:57:09,435::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 81105f27-0d06-428d-bedf-308ae0109fb5' (cwd None) >Thread-348::DEBUG::2012-11-29 13:57:09,587::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found\n'; <rc> = 5 >Thread-348::WARNING::2012-11-29 13:57:09,588::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "81105f27-0d06-428d-bedf-308ae0109fb5" not found'] >Thread-348::DEBUG::2012-11-29 13:57:09,588::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-348::DEBUG::2012-11-29 13:57:09,601::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323/81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-348::DEBUG::2012-11-29 13:57:09,602::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-348::DEBUG::2012-11-29 13:57:09,604::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'ROLE=Regular', 'SDUUID=81105f27-0d06-428d-bedf-308ae0109fb5', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3ed15eac66951f98207bd8b2bb4a06522c2e1362'] >Thread-348::DEBUG::2012-11-29 13:57:09,606::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-348::WARNING::2012-11-29 13:57:09,606::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_imageNS already registered >Thread-348::WARNING::2012-11-29 13:57:09,607::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 81105f27-0d06-428d-bedf-308ae0109fb5_volumeNS already registered >Thread-348::INFO::2012-11-29 13:57:09,607::fileSD::404::Storage.StorageDomain::(format) Formatting domain 81105f27-0d06-428d-bedf-308ae0109fb5 >Thread-348::INFO::2012-11-29 13:57:09,627::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-348::DEBUG::2012-11-29 13:57:09,627::task::1151::TaskManager.Task::(prepare) Task=`d80ce77b-c669-49b0-b4ef-6e59691a6ef1`::finished: None >Thread-348::DEBUG::2012-11-29 13:57:09,627::task::568::TaskManager.Task::(_updateState) Task=`d80ce77b-c669-49b0-b4ef-6e59691a6ef1`::moving from state preparing -> state finished >Thread-348::DEBUG::2012-11-29 13:57:09,628::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.81105f27-0d06-428d-bedf-308ae0109fb5': < ResourceRef 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', isValid: 'True' obj: 'None'>} >Thread-348::DEBUG::2012-11-29 13:57:09,628::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-348::DEBUG::2012-11-29 13:57:09,628::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' >Thread-348::DEBUG::2012-11-29 13:57:09,628::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' (0 active users) >Thread-348::DEBUG::2012-11-29 13:57:09,629::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5' is free, finding out if anyone is waiting for it. >Thread-348::DEBUG::2012-11-29 13:57:09,629::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.81105f27-0d06-428d-bedf-308ae0109fb5', Clearing records. >Thread-348::DEBUG::2012-11-29 13:57:09,629::task::957::TaskManager.Task::(_decref) Task=`d80ce77b-c669-49b0-b4ef-6e59691a6ef1`::ref 0 aborting False >Thread-362::DEBUG::2012-11-29 13:57:09,662::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-362::DEBUG::2012-11-29 13:57:09,662::task::568::TaskManager.Task::(_updateState) Task=`3699020a-4cda-4b46-85cb-a3c9743a2ca9`::moving from state init -> state preparing >Thread-362::INFO::2012-11-29 13:57:09,663::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129134633254323', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49', 'port': ''}], options=None) >Thread-362::DEBUG::2012-11-29 13:57:09,663::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129134633254323' (cwd None) >Thread-362::DEBUG::2012-11-29 13:57:09,691::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-362::DEBUG::2012-11-29 13:57:09,691::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-362::DEBUG::2012-11-29 13:57:09,692::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-362::DEBUG::2012-11-29 13:57:09,692::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-362::DEBUG::2012-11-29 13:57:09,692::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-362::DEBUG::2012-11-29 13:57:09,703::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-362::DEBUG::2012-11-29 13:57:09,703::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-362::DEBUG::2012-11-29 13:57:09,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-362::DEBUG::2012-11-29 13:57:09,707::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-362::DEBUG::2012-11-29 13:57:09,709::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-362::DEBUG::2012-11-29 13:57:09,711::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-362::DEBUG::2012-11-29 13:57:09,713::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-362::DEBUG::2012-11-29 13:57:09,715::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-362::DEBUG::2012-11-29 13:57:09,717::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-362::DEBUG::2012-11-29 13:57:11,720::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-362::DEBUG::2012-11-29 13:57:11,754::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-362::DEBUG::2012-11-29 13:57:11,754::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-362::DEBUG::2012-11-29 13:57:11,755::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-362::DEBUG::2012-11-29 13:57:11,755::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-362::DEBUG::2012-11-29 13:57:11,755::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-362::DEBUG::2012-11-29 13:57:11,755::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-362::DEBUG::2012-11-29 13:57:11,756::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-362::DEBUG::2012-11-29 13:57:11,756::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-362::INFO::2012-11-29 13:57:11,756::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-362::DEBUG::2012-11-29 13:57:11,756::task::1151::TaskManager.Task::(prepare) Task=`3699020a-4cda-4b46-85cb-a3c9743a2ca9`::finished: {'statuslist': [{'status': 0, 'id': '7aeeb4a8-2a72-499b-9c03-aec17e44dc49'}]} >Thread-362::DEBUG::2012-11-29 13:57:11,757::task::568::TaskManager.Task::(_updateState) Task=`3699020a-4cda-4b46-85cb-a3c9743a2ca9`::moving from state preparing -> state finished >Thread-362::DEBUG::2012-11-29 13:57:11,757::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-362::DEBUG::2012-11-29 13:57:11,757::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-362::DEBUG::2012-11-29 13:57:11,757::task::957::TaskManager.Task::(_decref) Task=`3699020a-4cda-4b46-85cb-a3c9743a2ca9`::ref 0 aborting False >Thread-364::DEBUG::2012-11-29 13:57:12,905::task::568::TaskManager.Task::(_updateState) Task=`52f5642b-7a47-4f0a-bb02-f7b506d31ae2`::moving from state init -> state preparing >Thread-364::INFO::2012-11-29 13:57:12,906::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-364::INFO::2012-11-29 13:57:12,906::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-364::DEBUG::2012-11-29 13:57:12,906::task::1151::TaskManager.Task::(prepare) Task=`52f5642b-7a47-4f0a-bb02-f7b506d31ae2`::finished: {} >Thread-364::DEBUG::2012-11-29 13:57:12,906::task::568::TaskManager.Task::(_updateState) Task=`52f5642b-7a47-4f0a-bb02-f7b506d31ae2`::moving from state preparing -> state finished >Thread-364::DEBUG::2012-11-29 13:57:12,906::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-364::DEBUG::2012-11-29 13:57:12,906::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-364::DEBUG::2012-11-29 13:57:12,907::task::957::TaskManager.Task::(_decref) Task=`52f5642b-7a47-4f0a-bb02-f7b506d31ae2`::ref 0 aborting False >MainThread::INFO::2012-11-29 14:10:27,811::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2012-11-29 14:10:27,818::task::568::TaskManager.Task::(_updateState) Task=`d7e479ec-cb69-4088-b716-fb2ab7a600f4`::moving from state init -> state preparing >MainThread::INFO::2012-11-29 14:10:27,818::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2012-11-29 14:10:27,819::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2012-11-29 14:10:27,830::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,831::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,833::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,834::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,835::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,837::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,838::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,840::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,841::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,842::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,844::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,845::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,847::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,848::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,849::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,851::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,852::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,854::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,855::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,856::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,858::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,859::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,861::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,862::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,863::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,865::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,866::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,867::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,869::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,870::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,872::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,873::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,875::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,876::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,877::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,879::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,880::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,882::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,883::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,884::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,886::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,887::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,889::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,890::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:10:27,986::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2012-11-29 14:10:27,986::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2012-11-29 14:10:27,986::task::1151::TaskManager.Task::(prepare) Task=`d7e479ec-cb69-4088-b716-fb2ab7a600f4`::finished: None >MainThread::DEBUG::2012-11-29 14:10:27,986::task::568::TaskManager.Task::(_updateState) Task=`d7e479ec-cb69-4088-b716-fb2ab7a600f4`::moving from state preparing -> state finished >MainThread::DEBUG::2012-11-29 14:10:27,987::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2012-11-29 14:10:27,987::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2012-11-29 14:10:27,987::task::957::TaskManager.Task::(_decref) Task=`d7e479ec-cb69-4088-b716-fb2ab7a600f4`::ref 0 aborting False >MainThread::INFO::2012-11-29 14:10:27,987::vdsm::94::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2012-11-29 14:10:27,987::vdsm::98::vds::(run) <_MainThread(MainThread, started 139920427865856)> >MainThread::INFO::2012-11-29 14:10:27,987::vdsm::98::vds::(run) <Thread(libvirtEventLoop, started daemon 139920242079488)> >MainThread::INFO::2012-11-29 14:10:27,988::vdsm::98::vds::(run) <WorkerThread(Thread-5, started daemon 139920070919936)> >MainThread::INFO::2012-11-29 14:10:27,988::vdsm::98::vds::(run) <WorkerThread(abeed7ab-76ea-49f6-b840-c52790fd7d58, started daemon 139920102389504)> >MainThread::INFO::2012-11-29 14:10:27,988::vdsm::98::vds::(run) <WorkerThread(762c836e-d92f-45ec-b423-46ba710e14aa, started daemon 139920081409792)> >MainThread::INFO::2012-11-29 14:10:27,988::vdsm::98::vds::(run) <WorkerThread(Thread-9, started daemon 139919622137600)> >MainThread::INFO::2012-11-29 14:10:27,988::vdsm::98::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139919162865408)> >MainThread::INFO::2012-11-29 14:10:27,988::vdsm::98::vds::(run) <WorkerThread(Thread-6, started daemon 139920060430080)> >MainThread::INFO::2012-11-29 14:10:27,988::vdsm::98::vds::(run) <WorkerThread(Thread-1, started daemon 139920189572864)> >MainThread::INFO::2012-11-29 14:10:27,989::vdsm::98::vds::(run) <WorkerThread(Thread-8, started daemon 139919632627456)> >MainThread::INFO::2012-11-29 14:10:27,989::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2012-11-29 14:10:27,989::vdsm::98::vds::(run) <Listener(VM Channels Listener, started daemon 139919141885696)> >MainThread::INFO::2012-11-29 14:10:27,989::vdsm::98::vds::(run) <WorkerThread(Thread-7, started daemon 139920049940224)> >MainThread::INFO::2012-11-29 14:10:27,989::vdsm::98::vds::(run) <WorkerThread(Thread-3, started daemon 139920091899648)> >MainThread::INFO::2012-11-29 14:10:27,989::vdsm::98::vds::(run) <WorkerThread(Thread-10, started daemon 139919611647744)> >MainThread::INFO::2012-11-29 14:15:48,362::vdsm::88::vds::(run) I am the actual vdsm 4.10-1.0 cinteg02.ci.lab.tlv.redhat.com (2.6.32-279.el6.x86_64) >MainThread::DEBUG::2012-11-29 14:15:49,873::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2012-11-29 14:15:49,873::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2012-11-29 14:15:49,888::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2012-11-29 14:15:49,915::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,916::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,918::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,919::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,921::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,924::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,926::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,928::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,930::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,933::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,935::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,937::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,939::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,941::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,943::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,945::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,948::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,949::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,951::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,952::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,954::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,956::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,957::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,959::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,960::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,962::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,964::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,965::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,967::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,968::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,970::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,971::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,973::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,974::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,976::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,977::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,979::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,981::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,983::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,984::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,986::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,987::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,989::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:49,990::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:15:50,094::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2012-11-29 14:15:50,094::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 6ae5dbb2-6183-45f1-a009-dbed1572f478 2704 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2012-11-29 14:15:50,853::supervdsmServer::332::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2012-11-29 14:15:50,853::supervdsmServer::336::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2012-11-29 14:15:50,854::supervdsmServer::340::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2012-11-29 14:15:50,854::supervdsmServer::347::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2012-11-29 14:15:50,854::supervdsmServer::351::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2012-11-29 14:15:50,854::supervdsmServer::359::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2012-11-29 14:15:50,856::supervdsmServer::371::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2012-11-29 14:15:52,211::supervdsm::176::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2012-11-29 14:15:52,230::multipath::112::Storage.Multipath::(isEnabled) Downrev multipath.conf detected, upgrade required >MainThread::DEBUG::2012-11-29 14:15:52,231::misc::509::Storage.Misc::(rotateFiles) dir: /etc, prefixName: multipath.conf, versions: 5 >MainThread::DEBUG::2012-11-29 14:15:52,231::misc::530::Storage.Misc::(rotateFiles) versions found: [] >MainThread::DEBUG::2012-11-29 14:15:52,233::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/cp /tmp/tmpNODPXa /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2012-11-29 14:15:52,255::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 14:15:52,255::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2012-11-29 14:15:52,272::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 14:15:52,273::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service multipathd restart' (cwd None) >MainThread::DEBUG::2012-11-29 14:15:52,448::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 14:15:52,448::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2012-11-29 14:15:52,613::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 14:15:52,614::hsm::426::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2012-11-29 14:15:52,616::hsm::458::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2012-11-29 14:15:52,617::hsm::459::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2012-11-29 14:15:52,617::hsm::461::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2012-11-29 14:15:52,632::hsm::504::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >Thread-12::DEBUG::2012-11-29 14:15:52,633::lvm::334::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >MainThread::INFO::2012-11-29 14:15:52,634::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >Thread-12::DEBUG::2012-11-29 14:15:52,639::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2012-11-29 14:15:52,653::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2012-11-29 14:15:52,697::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2012-11-29 14:15:52,770::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2012-11-29 14:15:52,770::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 99 >KsmMonitor::DEBUG::2012-11-29 14:15:52,771::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2012-11-29 14:15:52,771::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2012-11-29 14:15:52,805::vmChannels::127::vds::(run) Starting VM channels listener thread. >Thread-12::DEBUG::2012-11-29 14:15:52,807::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::WARNING::2012-11-29 14:15:52,807::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >Thread-12::DEBUG::2012-11-29 14:15:52,808::lvm::359::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >MainThread::WARNING::2012-11-29 14:15:52,809::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2012-11-29 14:15:52,810::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:15:52,810::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >KsmMonitor::DEBUG::2012-11-29 14:15:52,811::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >Thread-12::DEBUG::2012-11-29 14:15:52,811::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >KsmMonitor::DEBUG::2012-11-29 14:15:52,846::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:15:52,970::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:15:52,970::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:15:52,971::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-12::DEBUG::2012-11-29 14:15:53,122::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:15:53,123::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-12::DEBUG::2012-11-29 14:15:53,123::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 14:15:53,123::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-12::DEBUG::2012-11-29 14:15:53,123::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 14:15:53,123::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2012-11-29 14:15:53,175::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-12::DEBUG::2012-11-29 14:15:53,175::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-12::DEBUG::2012-11-29 14:15:53,178::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:15:53,180::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:15:53,182::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:15:53,184::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:15:53,186::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:15:53,188::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:15:53,190::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-12::DEBUG::2012-11-29 14:15:55,193::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-12::DEBUG::2012-11-29 14:15:55,275::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:15:55,275::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 14:15:55,276::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:15:55,276::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 14:15:55,276::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:15:55,276::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 14:15:55,277::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:15:55,277::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2012-11-29 14:18:05,083::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-14::DEBUG::2012-11-29 14:18:05,305::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.041', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-15::DEBUG::2012-11-29 14:18:05,459::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-15::DEBUG::2012-11-29 14:18:05,476::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.041', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-19::DEBUG::2012-11-29 14:18:11,810::task::568::TaskManager.Task::(_updateState) Task=`3c66f87a-6f4e-4883-9977-e4bb67bc04a8`::moving from state init -> state preparing >Thread-19::INFO::2012-11-29 14:18:11,811::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::INFO::2012-11-29 14:18:11,811::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-19::DEBUG::2012-11-29 14:18:11,811::task::1151::TaskManager.Task::(prepare) Task=`3c66f87a-6f4e-4883-9977-e4bb67bc04a8`::finished: {} >Thread-19::DEBUG::2012-11-29 14:18:11,811::task::568::TaskManager.Task::(_updateState) Task=`3c66f87a-6f4e-4883-9977-e4bb67bc04a8`::moving from state preparing -> state finished >Thread-19::DEBUG::2012-11-29 14:18:11,811::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2012-11-29 14:18:11,811::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2012-11-29 14:18:11,811::task::957::TaskManager.Task::(_decref) Task=`3c66f87a-6f4e-4883-9977-e4bb67bc04a8`::ref 0 aborting False >Thread-24::DEBUG::2012-11-29 14:18:20,126::task::568::TaskManager.Task::(_updateState) Task=`91884277-3d34-4c32-9ec2-d36e370944dc`::moving from state init -> state preparing >Thread-24::INFO::2012-11-29 14:18:20,126::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-24::INFO::2012-11-29 14:18:20,126::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-24::DEBUG::2012-11-29 14:18:20,126::task::1151::TaskManager.Task::(prepare) Task=`91884277-3d34-4c32-9ec2-d36e370944dc`::finished: {} >Thread-24::DEBUG::2012-11-29 14:18:20,126::task::568::TaskManager.Task::(_updateState) Task=`91884277-3d34-4c32-9ec2-d36e370944dc`::moving from state preparing -> state finished >Thread-24::DEBUG::2012-11-29 14:18:20,127::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2012-11-29 14:18:20,127::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2012-11-29 14:18:20,127::task::957::TaskManager.Task::(_decref) Task=`91884277-3d34-4c32-9ec2-d36e370944dc`::ref 0 aborting False >MainThread::INFO::2012-11-29 14:18:35,113::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2012-11-29 14:18:35,118::task::568::TaskManager.Task::(_updateState) Task=`862c9c32-592c-4b08-b73e-b0d033e53336`::moving from state init -> state preparing >MainThread::INFO::2012-11-29 14:18:35,118::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2012-11-29 14:18:35,119::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2012-11-29 14:18:35,123::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,125::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,126::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,128::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,129::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,130::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,132::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,133::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,135::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,136::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,137::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,139::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,140::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,142::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,143::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,144::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,146::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,147::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,148::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,150::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,151::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,153::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,154::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,155::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,157::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,158::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,160::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,161::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,162::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,164::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,165::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,167::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,168::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,169::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,171::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,172::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,174::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,175::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,176::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,178::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,179::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,181::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,182::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,183::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:18:35,271::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2012-11-29 14:18:35,271::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2012-11-29 14:18:35,272::task::1151::TaskManager.Task::(prepare) Task=`862c9c32-592c-4b08-b73e-b0d033e53336`::finished: None >MainThread::DEBUG::2012-11-29 14:18:35,272::task::568::TaskManager.Task::(_updateState) Task=`862c9c32-592c-4b08-b73e-b0d033e53336`::moving from state preparing -> state finished >MainThread::DEBUG::2012-11-29 14:18:35,272::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2012-11-29 14:18:35,272::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2012-11-29 14:18:35,272::task::957::TaskManager.Task::(_decref) Task=`862c9c32-592c-4b08-b73e-b0d033e53336`::ref 0 aborting False >MainThread::INFO::2012-11-29 14:18:35,272::vdsm::94::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2012-11-29 14:18:35,273::vdsm::98::vds::(run) <_MainThread(MainThread, started 140436452562688)> >MainThread::INFO::2012-11-29 14:18:35,273::vdsm::98::vds::(run) <Thread(libvirtEventLoop, started daemon 140436266776320)> >MainThread::INFO::2012-11-29 14:18:35,273::vdsm::98::vds::(run) <WorkerThread(Thread-5, started daemon 140435901118208)> >MainThread::INFO::2012-11-29 14:18:35,273::vdsm::98::vds::(run) <WorkerThread(Thread-6, started daemon 140435890628352)> >MainThread::INFO::2012-11-29 14:18:35,273::vdsm::98::vds::(run) <WorkerThread(Thread-8, started daemon 140435869648640)> >MainThread::INFO::2012-11-29 14:18:35,273::vdsm::98::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140435399886592)> >MainThread::INFO::2012-11-29 14:18:35,273::vdsm::98::vds::(run) <WorkerThread(Thread-7, started daemon 140435880138496)> >MainThread::INFO::2012-11-29 14:18:35,274::vdsm::98::vds::(run) <WorkerThread(Thread-10, started daemon 140435848668928)> >MainThread::INFO::2012-11-29 14:18:35,274::vdsm::98::vds::(run) <WorkerThread(Thread-9, started daemon 140435859158784)> >MainThread::INFO::2012-11-29 14:18:35,274::vdsm::98::vds::(run) <WorkerThread(Thread-4, started daemon 140436114269952)> >MainThread::INFO::2012-11-29 14:18:35,274::vdsm::98::vds::(run) <WorkerThread(Thread-3, started daemon 140436124759808)> >MainThread::INFO::2012-11-29 14:18:35,274::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2012-11-29 14:18:35,274::vdsm::98::vds::(run) <Listener(VM Channels Listener, started daemon 140435378906880)> >MainThread::INFO::2012-11-29 14:18:35,274::vdsm::98::vds::(run) <WorkerThread(Thread-1, started daemon 140436145739520)> >MainThread::INFO::2012-11-29 14:18:35,275::vdsm::98::vds::(run) <WorkerThread(Thread-2, started daemon 140436135249664)> >MainThread::INFO::2012-11-29 14:21:18,702::vdsm::88::vds::(run) I am the actual vdsm 4.10-1.0 cinteg02.ci.lab.tlv.redhat.com (2.6.32-279.el6.x86_64) >MainThread::DEBUG::2012-11-29 14:21:18,944::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2012-11-29 14:21:18,945::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2012-11-29 14:21:18,948::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2012-11-29 14:21:18,980::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/710eab70-c931-406d-8875-c9bf0bbf5429/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,982::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/790d4afb-58b0-4708-8f66-7a4e9c8a1590/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,983::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/57f60ad1-1ebc-44b2-b622-3942dc04407c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,984::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/63044dd6-13a7-4066-b2f4-ee259f9801e5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,986::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/122d6c13-2c98-4245-8683-262e9d188bae/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,987::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cd269753-bfa5-4213-b85d-dac1670168ac/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,988::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c799eacc-8593-4d79-bfa0-cb17b788758f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,990::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/98971b1d-2ed4-4e13-80d5-06c09851fb6b/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,991::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d4dd7a9e-a005-4af0-9c2b-c6afebef40f6/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,993::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/306ba78b-f972-49bf-8ed6-984256f50fbf/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,994::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68fb237c-83e1-481e-a0bb-d27f68cc26e1/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,995::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7c2424fe-5ffb-43e5-9da6-288cdce9e448/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,997::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c63d9f50-22c5-4a8c-a42f-81574268adef/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,998::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3f6dd232-25a6-4fbd-98ce-69a6b3addcfe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:18,999::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/78196531-24d2-4c7f-afde-075e794d70a2/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,001::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/471e4038-22e4-4d16-93e2-d79ed92574bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,002::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b5f7e1d6-b3c2-49be-9560-4cdbbbcb0480/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,003::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/4df99599-51b8-49dc-b239-5b31d434ae26/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,005::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2daac10-215c-4c4a-9f49-301d5746b8b5/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,006::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/96604921-6910-4b83-ab18-040828dfdf59/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,008::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0f685b59-1b56-4577-9743-83c11966f9a7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,009::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2f3bf2d8-95b3-44cf-b978-cd1c8e174b0a/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,010::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e66d71b2-50df-4c65-815e-1bd8b9dadf0d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,012::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/674e8ee5-39f7-4433-aade-1b04bafb5f93/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,013::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3d389a9a-1c5e-45d7-842e-0995354fed3d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,014::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8e2135ec-d480-4749-bb37-25b2e78f21bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,016::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1485251e-1d57-413d-9067-9b98dfc12bdc/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,017::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cdc19b9f-3e96-4c3a-bca4-6aa01f39c2fe/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,019::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1d15a1a-0943-4d3f-8ba7-9439aee5b2bd/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,020::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2925ef27-5490-464a-ae5e-4c11a2deb7eb/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,021::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f630f888-e707-4952-b211-a1c299c7fb9e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,023::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/59ae8e8e-b100-4d0d-882b-51e08676b8c7/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,024::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/db061fe8-e520-4778-9dc9-665bfdb55bd4/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,025::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3a104cb1-47c4-4183-ae2c-c33c50545e21/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,027::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/f2c327fe-9065-4c30-a1ce-a578b907b05e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,028::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ba555d06-d5b8-49c7-aca4-961194197df8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,029::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/36ed93fb-5150-407b-80b4-a6e91d8c17a3/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,031::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/1fd2cc56-e1a8-4bdd-8bae-ddff1245064e/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,032::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/97cc76c4-565b-4071-9831-8116543a282c/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,034::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/cc9d3bf3-da18-460b-b333-2468b0f4983d/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,035::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9fbde61a-62cf-4d13-9ba9-9efa845a3609/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,036::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/258a39ca-a1b1-42b9-9abc-7a1c3b4fe94f/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,038::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/3e9f927e-fe10-48ad-b981-166ba45faac8/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,039::sp::359::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/41c9ec3b-a897-4ac2-9169-c4bf838b2d39/master` is not mounted, skipping >MainThread::DEBUG::2012-11-29 14:21:19,116::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2012-11-29 14:21:19,117::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 747c723c-4933-422e-bc45-e898a0a0aee7 2675 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2012-11-29 14:21:19,307::supervdsmServer::332::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2012-11-29 14:21:19,307::supervdsmServer::336::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2012-11-29 14:21:19,308::supervdsmServer::340::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2012-11-29 14:21:19,308::supervdsmServer::347::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2012-11-29 14:21:19,308::supervdsmServer::351::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2012-11-29 14:21:19,308::supervdsmServer::359::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2012-11-29 14:21:19,310::supervdsmServer::371::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2012-11-29 14:21:21,122::supervdsm::176::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2012-11-29 14:21:21,128::multipath::112::Storage.Multipath::(isEnabled) Downrev multipath.conf detected, upgrade required >MainThread::DEBUG::2012-11-29 14:21:21,128::misc::509::Storage.Misc::(rotateFiles) dir: /etc, prefixName: multipath.conf, versions: 5 >MainThread::DEBUG::2012-11-29 14:21:21,129::misc::530::Storage.Misc::(rotateFiles) versions found: [] >MainThread::DEBUG::2012-11-29 14:21:21,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/cp /tmp/tmpMFblrj /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2012-11-29 14:21:21,152::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 14:21:21,153::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2012-11-29 14:21:21,170::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 14:21:21,170::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service multipathd restart' (cwd None) >MainThread::DEBUG::2012-11-29 14:21:21,340::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 14:21:21,340::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2012-11-29 14:21:21,511::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 14:21:21,512::hsm::426::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2012-11-29 14:21:21,514::hsm::458::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2012-11-29 14:21:21,514::hsm::459::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2012-11-29 14:21:21,514::hsm::461::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2012-11-29 14:21:21,640::hsm::504::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2012-11-29 14:21:21,641::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >Thread-12::DEBUG::2012-11-29 14:21:21,641::lvm::334::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:21,648::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2012-11-29 14:21:21,660::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2012-11-29 14:21:21,661::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2012-11-29 14:21:21,704::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2012-11-29 14:21:21,705::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 99 >KsmMonitor::DEBUG::2012-11-29 14:21:21,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2012-11-29 14:21:21,706::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2012-11-29 14:21:21,711::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2012-11-29 14:21:21,720::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >MainThread::WARNING::2012-11-29 14:21:21,720::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2012-11-29 14:21:21,736::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2012-11-29 14:21:21,736::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2012-11-29 14:21:21,764::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:21:21,811::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:21:21,811::lvm::359::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:21,812::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:21,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-12::DEBUG::2012-11-29 14:21:21,998::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:21:21,998::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:21,999::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-12::DEBUG::2012-11-29 14:21:22,140::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:21:22,140::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-12::DEBUG::2012-11-29 14:21:22,140::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 14:21:22,140::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-12::DEBUG::2012-11-29 14:21:22,141::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 14:21:22,141::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2012-11-29 14:21:22,151::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >Thread-12::DEBUG::2012-11-29 14:21:22,151::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-12::DEBUG::2012-11-29 14:21:22,154::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:21:22,156::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:21:22,158::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:21:22,159::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:21:22,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:21:22,163::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 14:21:22,165::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-12::DEBUG::2012-11-29 14:21:25,693::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-12::DEBUG::2012-11-29 14:21:25,772::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 14:21:25,773::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:25,773::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:25,773::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:25,774::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:25,774::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:25,774::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 14:21:25,774::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-12::WARNING::2012-11-29 14:21:25,775::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-14::DEBUG::2012-11-29 14:23:41,959::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-14::DEBUG::2012-11-29 14:23:42,202::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.047', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-17::DEBUG::2012-11-29 14:23:46,531::task::568::TaskManager.Task::(_updateState) Task=`11a503e6-6ee7-41b9-8269-2804e7d033bb`::moving from state init -> state preparing >Thread-17::INFO::2012-11-29 14:23:46,531::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::INFO::2012-11-29 14:23:46,531::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-17::DEBUG::2012-11-29 14:23:46,531::task::1151::TaskManager.Task::(prepare) Task=`11a503e6-6ee7-41b9-8269-2804e7d033bb`::finished: {} >Thread-17::DEBUG::2012-11-29 14:23:46,531::task::568::TaskManager.Task::(_updateState) Task=`11a503e6-6ee7-41b9-8269-2804e7d033bb`::moving from state preparing -> state finished >Thread-17::DEBUG::2012-11-29 14:23:46,532::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2012-11-29 14:23:46,532::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2012-11-29 14:23:46,532::task::957::TaskManager.Task::(_decref) Task=`11a503e6-6ee7-41b9-8269-2804e7d033bb`::ref 0 aborting False >Thread-19::DEBUG::2012-11-29 14:23:48,655::task::568::TaskManager.Task::(_updateState) Task=`58ed4feb-cb82-4cc6-aa5c-231dac620354`::moving from state init -> state preparing >Thread-19::INFO::2012-11-29 14:23:48,656::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::INFO::2012-11-29 14:23:48,656::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-19::DEBUG::2012-11-29 14:23:48,656::task::1151::TaskManager.Task::(prepare) Task=`58ed4feb-cb82-4cc6-aa5c-231dac620354`::finished: {} >Thread-19::DEBUG::2012-11-29 14:23:48,656::task::568::TaskManager.Task::(_updateState) Task=`58ed4feb-cb82-4cc6-aa5c-231dac620354`::moving from state preparing -> state finished >Thread-19::DEBUG::2012-11-29 14:23:48,656::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2012-11-29 14:23:48,656::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2012-11-29 14:23:48,657::task::957::TaskManager.Task::(_decref) Task=`58ed4feb-cb82-4cc6-aa5c-231dac620354`::ref 0 aborting False >Thread-21::DEBUG::2012-11-29 14:23:59,148::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} flowID [109] >Thread-21::DEBUG::2012-11-29 14:23:59,166::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.047', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-22::DEBUG::2012-11-29 14:24:00,943::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-22::DEBUG::2012-11-29 14:24:00,960::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6C:FF:CB:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.047', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-26::DEBUG::2012-11-29 14:24:07,336::task::568::TaskManager.Task::(_updateState) Task=`05091c3b-850b-400f-b6b0-67850ba2deb9`::moving from state init -> state preparing >Thread-26::INFO::2012-11-29 14:24:07,336::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-26::INFO::2012-11-29 14:24:07,336::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-26::DEBUG::2012-11-29 14:24:07,336::task::1151::TaskManager.Task::(prepare) Task=`05091c3b-850b-400f-b6b0-67850ba2deb9`::finished: {} >Thread-26::DEBUG::2012-11-29 14:24:07,336::task::568::TaskManager.Task::(_updateState) Task=`05091c3b-850b-400f-b6b0-67850ba2deb9`::moving from state preparing -> state finished >Thread-26::DEBUG::2012-11-29 14:24:07,336::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26::DEBUG::2012-11-29 14:24:07,337::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26::DEBUG::2012-11-29 14:24:07,337::task::957::TaskManager.Task::(_decref) Task=`05091c3b-850b-400f-b6b0-67850ba2deb9`::ref 0 aborting False >Thread-32::DEBUG::2012-11-29 14:24:17,669::task::568::TaskManager.Task::(_updateState) Task=`e344b882-0812-4260-89f3-e48d59eec7ff`::moving from state init -> state preparing >Thread-32::INFO::2012-11-29 14:24:17,669::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-32::INFO::2012-11-29 14:24:17,669::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-32::DEBUG::2012-11-29 14:24:17,670::task::1151::TaskManager.Task::(prepare) Task=`e344b882-0812-4260-89f3-e48d59eec7ff`::finished: {} >Thread-32::DEBUG::2012-11-29 14:24:17,670::task::568::TaskManager.Task::(_updateState) Task=`e344b882-0812-4260-89f3-e48d59eec7ff`::moving from state preparing -> state finished >Thread-32::DEBUG::2012-11-29 14:24:17,670::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-32::DEBUG::2012-11-29 14:24:17,670::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2012-11-29 14:24:17,670::task::957::TaskManager.Task::(_decref) Task=`e344b882-0812-4260-89f3-e48d59eec7ff`::ref 0 aborting False >Thread-35::DEBUG::2012-11-29 14:24:20,910::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call addNetwork with ('testrest1', '', '', ['eth1'], {'STP': 'no', 'bridged': 'true'}) {} flowID [115] >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:20,941::configNetwork::881::root::(addNetwork) validating network... >MainProcess|Thread-35::INFO::2012-11-29 14:24:20,942::configNetwork::890::root::(addNetwork) Adding network testrest1 with vlan=None, bonding=None, nics=['eth1'], bondingOptions=None, mtu=None, bridged=True, options={'STP': 'no'} >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:20,942::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/ifdown eth1' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,281::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,281::configNetwork::335::root::(_persistentBackup) backing up ifcfg-testrest1: # original file did not exist > >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,293::configNetwork::247::root::(writeBackupFile) Persistently backed up /var/lib/vdsm/netconfback/ifcfg-testrest1 (until next 'set safe config') >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,416::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/ifdown testrest1' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,511::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,527::configNetwork::303::root::(_atomicBackup) Backed up /etc/sysconfig/network-scripts/ifcfg-eth1 >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,527::configNetwork::335::root::(_persistentBackup) backing up ifcfg-eth1: DEVICE=eth1 >ONBOOT=yes >HWADDR=00:26:6C:FF:CB:91 > >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,528::configNetwork::247::root::(writeBackupFile) Persistently backed up /var/lib/vdsm/netconfback/ifcfg-eth1 (until next 'set safe config') >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,529::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/ifup eth1' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,679::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,679::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/ifup testrest1' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,745::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,746::configNetwork::257::root::(_atomicNetworkBackup) Backed up testrest1 >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,747::configNetwork::266::root::(_persistentNetworkBackup) backing up network testrest1: # original file did not exist > >MainProcess|Thread-35::DEBUG::2012-11-29 14:24:21,747::configNetwork::247::root::(writeBackupFile) Persistently backed up /var/lib/vdsm/netconfback/logicalnetworks/testrest1 (until next 'set safe config') >Thread-35::DEBUG::2012-11-29 14:24:21,847::BindingXMLRPC::910::vds::(wrapper) return addNetwork with {'status': {'message': 'Done', 'code': 0}} >Thread-37::DEBUG::2012-11-29 14:24:21,900::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} flowID [115] >Thread-37::DEBUG::2012-11-29 14:24:21,922::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}, 'testrest1': {'iface': 'testrest1', 'addr': '', 'cfg': {'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'testrest1', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '0.0.0.0', 'ports': ['eth1']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}, 'testrest1': {'addr': '', 'cfg': {'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'testrest1', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth1']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'BRIDGE': 'testrest1', 'NM_CONTROLLED': 'no', 'HWADDR': '00:26:6c:ff:cb:91', 'STP': 'no', 'DEVICE': 'eth1', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.047', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-38::DEBUG::2012-11-29 14:24:23,562::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call delNetwork with ('testrest1', '', '', ['eth1']) {} flowID [117] >Thread-38::WARNING::2012-11-29 14:24:23,562::API::1228::vds::(delNetwork) Specifying vlan, bond or nics to delNetwork is deprecated >MainProcess|Thread-38::INFO::2012-11-29 14:24:23,585::configNetwork::1059::root::(delNetwork) Removing network testrest1 with vlan=None, bonding=None, nics=['eth1'],options={} >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,597::configNetwork::257::root::(_atomicNetworkBackup) Backed up testrest1 >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,599::configNetwork::266::root::(_persistentNetworkBackup) backing up network testrest1: <network> > <name>vdsm-testrest1</name> > <uuid>4f9cad22-b44b-5b20-d632-e03e4f7255e4</uuid> > <forward mode='bridge'/> > <bridge name='testrest1' /> ></network> > >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,610::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/ifdown testrest1' (cwd None) >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,714::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,714::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/sbin/brctl delbr testrest1' (cwd None) >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,731::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,731::configNetwork::303::root::(_atomicBackup) Backed up /etc/sysconfig/network-scripts/ifcfg-testrest1 >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,732::configNetwork::335::root::(_persistentBackup) backing up ifcfg-testrest1: DEVICE=testrest1 >ONBOOT=yes >TYPE=Bridge >DELAY=0 >NM_CONTROLLED=no >STP=no > >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,732::configNetwork::179::root::(_removeFile) Removed file /etc/sysconfig/network-scripts/ifcfg-testrest1 >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,732::configNetwork::303::root::(_atomicBackup) Backed up /etc/sysconfig/network-scripts/ifcfg-eth1 >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,733::configNetwork::335::root::(_persistentBackup) backing up ifcfg-eth1: DEVICE=eth1 >ONBOOT=yes >HWADDR=00:26:6c:ff:cb:91 >BRIDGE=testrest1 >NM_CONTROLLED=no >STP=no > >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,742::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/ifdown eth1' (cwd None) >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,993::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,994::configNetwork::335::root::(_persistentBackup) backing up ifcfg-eth1: DEVICE=eth1 >ONBOOT=yes >HWADDR=00:26:6c:ff:cb:91 >NM_CONTROLLED=no >STP=no > >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:23,994::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/ifup eth1' (cwd None) >MainProcess|Thread-38::DEBUG::2012-11-29 14:24:24,180::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-38::DEBUG::2012-11-29 14:24:24,181::BindingXMLRPC::910::vds::(wrapper) return delNetwork with {'status': {'message': 'Done', 'code': 0}} >Thread-40::DEBUG::2012-11-29 14:24:24,226::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} flowID [117] >Thread-40::DEBUG::2012-11-29 14:24:24,243::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.047', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-41::DEBUG::2012-11-29 14:24:25,509::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call setSafeNetworkConfig with () {} flowID [25be08d5] >MainProcess|Thread-41::DEBUG::2012-11-29 14:24:25,510::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/share/vdsm/vdsm-store-net-config' (cwd None) >MainProcess|Thread-41::DEBUG::2012-11-29 14:24:25,525::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-41::DEBUG::2012-11-29 14:24:25,525::BindingXMLRPC::910::vds::(wrapper) return setSafeNetworkConfig with {'status': {'message': 'Done', 'code': 0}} >Thread-43::DEBUG::2012-11-29 14:24:28,014::task::568::TaskManager.Task::(_updateState) Task=`0d38d3d4-2cf8-47ed-8604-b6b490c02d07`::moving from state init -> state preparing >Thread-43::INFO::2012-11-29 14:24:28,015::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-43::INFO::2012-11-29 14:24:28,015::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-43::DEBUG::2012-11-29 14:24:28,015::task::1151::TaskManager.Task::(prepare) Task=`0d38d3d4-2cf8-47ed-8604-b6b490c02d07`::finished: {} >Thread-43::DEBUG::2012-11-29 14:24:28,015::task::568::TaskManager.Task::(_updateState) Task=`0d38d3d4-2cf8-47ed-8604-b6b490c02d07`::moving from state preparing -> state finished >Thread-43::DEBUG::2012-11-29 14:24:28,015::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-43::DEBUG::2012-11-29 14:24:28,015::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2012-11-29 14:24:28,016::task::957::TaskManager.Task::(_decref) Task=`0d38d3d4-2cf8-47ed-8604-b6b490c02d07`::ref 0 aborting False >Thread-45::DEBUG::2012-11-29 14:24:39,239::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} flowID [122] >Thread-45::DEBUG::2012-11-29 14:24:39,256::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.047', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-46::DEBUG::2012-11-29 14:24:40,234::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-46::DEBUG::2012-11-29 14:24:40,250::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.047', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-51::DEBUG::2012-11-29 14:24:48,482::task::568::TaskManager.Task::(_updateState) Task=`52696c4c-dd28-4434-aaa7-e4f44caa4a7e`::moving from state init -> state preparing >Thread-51::INFO::2012-11-29 14:24:48,482::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-51::INFO::2012-11-29 14:24:48,482::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-51::DEBUG::2012-11-29 14:24:48,482::task::1151::TaskManager.Task::(prepare) Task=`52696c4c-dd28-4434-aaa7-e4f44caa4a7e`::finished: {} >Thread-51::DEBUG::2012-11-29 14:24:48,483::task::568::TaskManager.Task::(_updateState) Task=`52696c4c-dd28-4434-aaa7-e4f44caa4a7e`::moving from state preparing -> state finished >Thread-51::DEBUG::2012-11-29 14:24:48,483::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2012-11-29 14:24:48,483::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2012-11-29 14:24:48,483::task::957::TaskManager.Task::(_decref) Task=`52696c4c-dd28-4434-aaa7-e4f44caa4a7e`::ref 0 aborting False >Thread-54::DEBUG::2012-11-29 14:24:52,581::task::568::TaskManager.Task::(_updateState) Task=`491c877e-c7fd-4351-9bf7-84f123d301e9`::moving from state init -> state preparing >Thread-54::INFO::2012-11-29 14:24:52,581::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54::INFO::2012-11-29 14:24:52,581::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-54::DEBUG::2012-11-29 14:24:52,582::task::1151::TaskManager.Task::(prepare) Task=`491c877e-c7fd-4351-9bf7-84f123d301e9`::finished: {} >Thread-54::DEBUG::2012-11-29 14:24:52,582::task::568::TaskManager.Task::(_updateState) Task=`491c877e-c7fd-4351-9bf7-84f123d301e9`::moving from state preparing -> state finished >Thread-54::DEBUG::2012-11-29 14:24:52,582::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2012-11-29 14:24:52,582::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2012-11-29 14:24:52,582::task::957::TaskManager.Task::(_decref) Task=`491c877e-c7fd-4351-9bf7-84f123d301e9`::ref 0 aborting False >MainThread::INFO::2012-11-29 14:55:49,645::vmChannels::135::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2012-11-29 14:55:49,651::task::568::TaskManager.Task::(_updateState) Task=`db23577d-e154-42f6-8fb8-d1637194c3c2`::moving from state init -> state preparing >MainThread::INFO::2012-11-29 14:55:49,651::logUtils::37::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2012-11-29 14:55:49,652::storageServer::674::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2012-11-29 14:55:49,741::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2012-11-29 14:55:49,742::logUtils::39::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2012-11-29 14:55:49,742::task::1151::TaskManager.Task::(prepare) Task=`db23577d-e154-42f6-8fb8-d1637194c3c2`::finished: None >MainThread::DEBUG::2012-11-29 14:55:49,742::task::568::TaskManager.Task::(_updateState) Task=`db23577d-e154-42f6-8fb8-d1637194c3c2`::moving from state preparing -> state finished >MainThread::DEBUG::2012-11-29 14:55:49,742::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2012-11-29 14:55:49,742::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2012-11-29 14:55:49,742::task::957::TaskManager.Task::(_decref) Task=`db23577d-e154-42f6-8fb8-d1637194c3c2`::ref 0 aborting False >MainThread::INFO::2012-11-29 14:55:49,742::vdsm::94::vds::(run) VDSM main thread ended. Waiting for 12 other threads... >MainThread::INFO::2012-11-29 14:55:49,743::vdsm::98::vds::(run) <_MainThread(MainThread, started 140211353163520)> >MainThread::INFO::2012-11-29 14:55:49,743::vdsm::98::vds::(run) <Thread(libvirtEventLoop, started daemon 140211167377152)> >MainThread::INFO::2012-11-29 14:55:49,743::vdsm::98::vds::(run) <WorkerThread(Thread-7, started daemon 140210910246656)> >MainThread::INFO::2012-11-29 14:55:49,743::vdsm::98::vds::(run) <WorkerThread(Thread-10, started daemon 140210471954176)> >MainThread::INFO::2012-11-29 14:55:49,743::vdsm::98::vds::(run) <WorkerThread(Thread-6, started daemon 140210920736512)> >MainThread::INFO::2012-11-29 14:55:49,743::vdsm::98::vds::(run) <WorkerThread(Thread-1, started daemon 140211046774528)> >MainThread::INFO::2012-11-29 14:55:49,743::vdsm::98::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140210429994752)> >MainThread::INFO::2012-11-29 14:55:49,744::vdsm::98::vds::(run) <WorkerThread(Thread-5, started daemon 140210931226368)> >MainThread::INFO::2012-11-29 14:55:49,744::vdsm::98::vds::(run) <WorkerThread(Thread-8, started daemon 140210899756800)> >MainThread::INFO::2012-11-29 14:55:49,744::vdsm::98::vds::(run) <WorkerThread(Thread-2, started daemon 140211036284672)> >MainThread::INFO::2012-11-29 14:55:49,744::vdsm::98::vds::(run) <WorkerThread(Thread-3, started daemon 140210952206080)> >MainThread::INFO::2012-11-29 14:55:49,744::vdsm::98::vds::(run) <WorkerThread(Thread-9, started daemon 140210482444032)> >MainThread::INFO::2012-11-29 14:55:49,744::vdsm::98::vds::(run) <WorkerThread(Thread-4, started daemon 140210941716224)> >MainThread::INFO::2012-11-29 15:00:49,968::vdsm::88::vds::(run) I am the actual vdsm 4.10-1.0 cinteg02.ci.lab.tlv.redhat.com (2.6.32-279.el6.x86_64) >MainThread::DEBUG::2012-11-29 15:00:50,989::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2012-11-29 15:00:50,989::threadPool::33::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::DEBUG::2012-11-29 15:00:51,160::supervdsm::117::SuperVdsmProxy::(_start) Launching Super Vdsm >MainThread::DEBUG::2012-11-29 15:00:51,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 1e050f4c-1990-42ac-b8fe-d3be91c7d8da 2786 /var/run/vdsm/svdsm.pid /var/run/vdsm/svdsm.time /var/run/vdsm/svdsm.sock 36' (cwd None) >MainThread::DEBUG::2012-11-29 15:00:52,119::supervdsmServer::332::SuperVdsm.Server::(main) Making sure I'm root >MainThread::DEBUG::2012-11-29 15:00:52,119::supervdsmServer::336::SuperVdsm.Server::(main) Parsing cmd args >MainThread::DEBUG::2012-11-29 15:00:52,119::supervdsmServer::340::SuperVdsm.Server::(main) Creating PID and TIMESTAMP files: /var/run/vdsm/svdsm.pid, /var/run/vdsm/svdsm.time >MainThread::DEBUG::2012-11-29 15:00:52,119::supervdsmServer::347::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock >MainThread::DEBUG::2012-11-29 15:00:52,120::supervdsmServer::351::SuperVdsm.Server::(main) Setting up keep alive thread >MainThread::DEBUG::2012-11-29 15:00:52,120::supervdsmServer::359::SuperVdsm.Server::(main) Creating remote object manager >MainThread::DEBUG::2012-11-29 15:00:52,122::supervdsmServer::371::SuperVdsm.Server::(main) Started serving super vdsm object >MainThread::DEBUG::2012-11-29 15:00:53,193::supervdsm::176::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2012-11-29 15:00:53,205::multipath::112::Storage.Multipath::(isEnabled) Downrev multipath.conf detected, upgrade required >MainThread::DEBUG::2012-11-29 15:00:53,205::misc::509::Storage.Misc::(rotateFiles) dir: /etc, prefixName: multipath.conf, versions: 5 >MainThread::DEBUG::2012-11-29 15:00:53,206::misc::530::Storage.Misc::(rotateFiles) versions found: [] >MainThread::DEBUG::2012-11-29 15:00:53,207::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/cp /tmp/tmpmlptRe /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2012-11-29 15:00:53,223::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 15:00:53,224::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2012-11-29 15:00:53,239::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 15:00:53,240::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service multipathd restart' (cwd None) >MainThread::DEBUG::2012-11-29 15:00:53,429::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 15:00:53,430::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2012-11-29 15:00:53,589::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2012-11-29 15:00:53,589::hsm::426::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2012-11-29 15:00:53,594::hsm::458::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2012-11-29 15:00:53,594::hsm::459::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2012-11-29 15:00:53,594::hsm::461::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2012-11-29 15:00:53,596::hsm::504::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2012-11-29 15:00:53,598::dispatcher::95::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >Thread-12::DEBUG::2012-11-29 15:00:53,598::lvm::334::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:53,604::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2012-11-29 15:00:53,617::clientIF::197::vds::(_prepareMOM) MOM initialization failed and fall back to KsmMonitor >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 194, in _prepareMOM > self.mom = MomThread(momconf) > File "/usr/share/vdsm/momIF.py", line 34, in __init__ > raise Exception("MOM is not available") >Exception: MOM is not available >MainThread::DEBUG::2012-11-29 15:00:53,639::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/pgrep -xf ksmd' (cwd None) >Thread-12::DEBUG::2012-11-29 15:00:53,798::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 15:00:53,799::lvm::359::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:53,799::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:53,800::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >MainThread::DEBUG::2012-11-29 15:00:53,825::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2012-11-29 15:00:53,826::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 99 >KsmMonitor::DEBUG::2012-11-29 15:00:53,826::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2012-11-29 15:00:53,827::vmChannels::139::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2012-11-29 15:00:53,832::vmChannels::127::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2012-11-29 15:00:53,912::clientIF::182::vds::(_prepareBindings) Unable to load the rest server module. Please make sure it is installed. >KsmMonitor::DEBUG::2012-11-29 15:00:53,914::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainThread::WARNING::2012-11-29 15:00:53,915::clientIF::188::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >KsmMonitor::DEBUG::2012-11-29 15:00:53,915::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2012-11-29 15:00:53,951::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 15:00:53,956::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 15:00:53,956::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:53,957::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-12::DEBUG::2012-11-29 15:00:54,110::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-12::DEBUG::2012-11-29 15:00:54,110::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-12::DEBUG::2012-11-29 15:00:54,110::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 15:00:54,110::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-12::DEBUG::2012-11-29 15:00:54,111::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-12::DEBUG::2012-11-29 15:00:54,111::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2012-11-29 15:00:54,129::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 15:00:54,129::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-12::DEBUG::2012-11-29 15:00:54,132::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 15:00:54,135::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 15:00:54,137::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 15:00:54,140::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 15:00:54,142::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 15:00:54,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 15:00:54,147::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-12::DEBUG::2012-11-29 15:00:54,149::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-12::DEBUG::2012-11-29 15:00:56,153::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-12::DEBUG::2012-11-29 15:00:56,238::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2012-11-29 15:00:56,239::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:56,239::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:56,239::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:56,240::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:56,240::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:56,240::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-12::DEBUG::2012-11-29 15:00:56,241::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2012-11-29 15:03:06,250::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-14::DEBUG::2012-11-29 15:03:06,480::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.150', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-15::DEBUG::2012-11-29 15:03:06,634::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-15::DEBUG::2012-11-29 15:03:06,652::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.150', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-20::DEBUG::2012-11-29 15:03:15,044::task::568::TaskManager.Task::(_updateState) Task=`1e8287cc-e733-4224-8cd8-e3e4b444ddfd`::moving from state init -> state preparing >Thread-20::INFO::2012-11-29 15:03:15,044::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-20::INFO::2012-11-29 15:03:15,044::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-20::DEBUG::2012-11-29 15:03:15,044::task::1151::TaskManager.Task::(prepare) Task=`1e8287cc-e733-4224-8cd8-e3e4b444ddfd`::finished: {} >Thread-20::DEBUG::2012-11-29 15:03:15,045::task::568::TaskManager.Task::(_updateState) Task=`1e8287cc-e733-4224-8cd8-e3e4b444ddfd`::moving from state preparing -> state finished >Thread-20::DEBUG::2012-11-29 15:03:15,045::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2012-11-29 15:03:15,045::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2012-11-29 15:03:15,045::task::957::TaskManager.Task::(_decref) Task=`1e8287cc-e733-4224-8cd8-e3e4b444ddfd`::ref 0 aborting False >Thread-22::DEBUG::2012-11-29 15:03:17,218::task::568::TaskManager.Task::(_updateState) Task=`049258da-bb1f-40ee-bb03-0bedf28bec92`::moving from state init -> state preparing >Thread-22::INFO::2012-11-29 15:03:17,218::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-22::INFO::2012-11-29 15:03:17,218::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-22::DEBUG::2012-11-29 15:03:17,219::task::1151::TaskManager.Task::(prepare) Task=`049258da-bb1f-40ee-bb03-0bedf28bec92`::finished: {} >Thread-22::DEBUG::2012-11-29 15:03:17,219::task::568::TaskManager.Task::(_updateState) Task=`049258da-bb1f-40ee-bb03-0bedf28bec92`::moving from state preparing -> state finished >Thread-22::DEBUG::2012-11-29 15:03:17,219::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2012-11-29 15:03:17,219::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2012-11-29 15:03:17,219::task::957::TaskManager.Task::(_decref) Task=`049258da-bb1f-40ee-bb03-0bedf28bec92`::ref 0 aborting False >Thread-24::DEBUG::2012-11-29 15:03:27,629::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} flowID [56a124a0] >Thread-24::DEBUG::2012-11-29 15:03:27,646::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.150', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-25::DEBUG::2012-11-29 15:03:29,373::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-25::DEBUG::2012-11-29 15:03:29,390::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.150', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-29::DEBUG::2012-11-29 15:03:35,605::task::568::TaskManager.Task::(_updateState) Task=`c168ce4a-cc77-4f70-8765-c8adbe9ee368`::moving from state init -> state preparing >Thread-29::INFO::2012-11-29 15:03:35,605::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-29::INFO::2012-11-29 15:03:35,605::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-29::DEBUG::2012-11-29 15:03:35,605::task::1151::TaskManager.Task::(prepare) Task=`c168ce4a-cc77-4f70-8765-c8adbe9ee368`::finished: {} >Thread-29::DEBUG::2012-11-29 15:03:35,606::task::568::TaskManager.Task::(_updateState) Task=`c168ce4a-cc77-4f70-8765-c8adbe9ee368`::moving from state preparing -> state finished >Thread-29::DEBUG::2012-11-29 15:03:35,606::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2012-11-29 15:03:35,606::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2012-11-29 15:03:35,606::task::957::TaskManager.Task::(_decref) Task=`c168ce4a-cc77-4f70-8765-c8adbe9ee368`::ref 0 aborting False >Thread-33::DEBUG::2012-11-29 15:03:41,136::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-33::DEBUG::2012-11-29 15:03:41,136::task::568::TaskManager.Task::(_updateState) Task=`59cd081e-ed17-42e5-90ab-71ed975a03af`::moving from state init -> state preparing >Thread-33::INFO::2012-11-29 15:03:41,136::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-33::INFO::2012-11-29 15:03:41,136::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-33::DEBUG::2012-11-29 15:03:41,136::task::1151::TaskManager.Task::(prepare) Task=`59cd081e-ed17-42e5-90ab-71ed975a03af`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-33::DEBUG::2012-11-29 15:03:41,137::task::568::TaskManager.Task::(_updateState) Task=`59cd081e-ed17-42e5-90ab-71ed975a03af`::moving from state preparing -> state finished >Thread-33::DEBUG::2012-11-29 15:03:41,137::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-33::DEBUG::2012-11-29 15:03:41,137::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-33::DEBUG::2012-11-29 15:03:41,137::task::957::TaskManager.Task::(_decref) Task=`59cd081e-ed17-42e5-90ab-71ed975a03af`::ref 0 aborting False >Thread-34::DEBUG::2012-11-29 15:03:41,182::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-34::DEBUG::2012-11-29 15:03:41,182::task::568::TaskManager.Task::(_updateState) Task=`062017f8-e2ab-4577-ba53-af5ee470aa88`::moving from state init -> state preparing >Thread-34::INFO::2012-11-29 15:03:41,183::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-34::INFO::2012-11-29 15:03:41,280::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-34::DEBUG::2012-11-29 15:03:41,280::task::1151::TaskManager.Task::(prepare) Task=`062017f8-e2ab-4577-ba53-af5ee470aa88`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-34::DEBUG::2012-11-29 15:03:41,280::task::568::TaskManager.Task::(_updateState) Task=`062017f8-e2ab-4577-ba53-af5ee470aa88`::moving from state preparing -> state finished >Thread-34::DEBUG::2012-11-29 15:03:41,280::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2012-11-29 15:03:41,281::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2012-11-29 15:03:41,281::task::957::TaskManager.Task::(_decref) Task=`062017f8-e2ab-4577-ba53-af5ee470aa88`::ref 0 aborting False >Thread-35::DEBUG::2012-11-29 15:03:41,414::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-35::DEBUG::2012-11-29 15:03:41,415::task::568::TaskManager.Task::(_updateState) Task=`f815d431-a76c-4367-a7ee-a74b4ae0ea62`::moving from state init -> state preparing >Thread-35::INFO::2012-11-29 15:03:41,415::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=4, sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', domainName='RestDataDomain_LOCAL', typeSpecificArg='/home/rest_test_domain', domClass=1, domVersion='0', options=None) >Thread-35::DEBUG::2012-11-29 15:03:41,415::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-35::DEBUG::2012-11-29 15:03:41,415::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-35::DEBUG::2012-11-29 15:03:41,416::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-35::DEBUG::2012-11-29 15:03:41,416::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-35::DEBUG::2012-11-29 15:03:41,416::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-35::DEBUG::2012-11-29 15:03:41,438::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2012-11-29 15:03:41,438::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-35::DEBUG::2012-11-29 15:03:41,440::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 15:03:41,442::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 15:03:41,444::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 15:03:41,446::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 15:03:41,449::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 15:03:41,451::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 15:03:41,453::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-35::DEBUG::2012-11-29 15:03:42,456::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-35::DEBUG::2012-11-29 15:03:44,459::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-35::DEBUG::2012-11-29 15:03:44,557::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2012-11-29 15:03:44,558::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-35::DEBUG::2012-11-29 15:03:44,562::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-35::DEBUG::2012-11-29 15:03:44,563::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-35::DEBUG::2012-11-29 15:03:44,563::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-35::DEBUG::2012-11-29 15:03:44,563::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-35::DEBUG::2012-11-29 15:03:44,563::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-35::DEBUG::2012-11-29 15:03:44,564::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-35::DEBUG::2012-11-29 15:03:44,564::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-35::DEBUG::2012-11-29 15:03:44,565::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4d25f33e-850f-4088-8f0b-e9cbc8276313' (cwd None) >Thread-35::DEBUG::2012-11-29 15:03:44,755::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found\n'; <rc> = 5 >Thread-35::WARNING::2012-11-29 15:03:44,756::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found'] >Thread-35::DEBUG::2012-11-29 15:03:44,757::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-35::INFO::2012-11-29 15:03:44,834::localFsSD::61::Storage.StorageDomain::(create) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 domainName=RestDataDomain_LOCAL remotePath=/home/rest_test_domain domClass=1 >Thread-35::DEBUG::2012-11-29 15:03:44,913::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-35::DEBUG::2012-11-29 15:03:44,914::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-35::WARNING::2012-11-29 15:03:44,914::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-35::DEBUG::2012-11-29 15:03:44,914::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-35::DEBUG::2012-11-29 15:03:44,914::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-35::DEBUG::2012-11-29 15:03:44,914::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=39fd13839ff0bd029089531529969c1c5df9d713'] >Thread-35::DEBUG::2012-11-29 15:03:44,916::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-35::DEBUG::2012-11-29 15:03:44,916::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-35::DEBUG::2012-11-29 15:03:44,916::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-35::DEBUG::2012-11-29 15:03:44,918::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=39fd13839ff0bd029089531529969c1c5df9d713'] >Thread-35::DEBUG::2012-11-29 15:03:44,920::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-35::DEBUG::2012-11-29 15:03:44,920::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS' >Thread-35::DEBUG::2012-11-29 15:03:44,920::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '4d25f33e-850f-4088-8f0b-e9cbc8276313_volumeNS' >Thread-35::DEBUG::2012-11-29 15:03:44,921::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-35::DEBUG::2012-11-29 15:03:44,934::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2012-11-29 15:03:44,934::sd::396::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-35::INFO::2012-11-29 15:03:44,934::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-35::DEBUG::2012-11-29 15:03:44,935::task::1151::TaskManager.Task::(prepare) Task=`f815d431-a76c-4367-a7ee-a74b4ae0ea62`::finished: None >Thread-35::DEBUG::2012-11-29 15:03:44,935::task::568::TaskManager.Task::(_updateState) Task=`f815d431-a76c-4367-a7ee-a74b4ae0ea62`::moving from state preparing -> state finished >Thread-35::DEBUG::2012-11-29 15:03:44,935::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-35::DEBUG::2012-11-29 15:03:44,935::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-35::DEBUG::2012-11-29 15:03:44,935::task::957::TaskManager.Task::(_decref) Task=`f815d431-a76c-4367-a7ee-a74b4ae0ea62`::ref 0 aborting False >Thread-40::DEBUG::2012-11-29 15:03:44,968::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-40::DEBUG::2012-11-29 15:03:44,969::task::568::TaskManager.Task::(_updateState) Task=`cac04049-cc39-4e1b-b077-56cc9a8b0e22`::moving from state init -> state preparing >Thread-40::INFO::2012-11-29 15:03:44,969::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', options=None) >Thread-40::DEBUG::2012-11-29 15:03:44,969::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`c8a15010-109b-4e14-a0fc-eaec0f0d76be`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-40::DEBUG::2012-11-29 15:03:44,970::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-40::DEBUG::2012-11-29 15:03:44,970::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-40::DEBUG::2012-11-29 15:03:44,970::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`c8a15010-109b-4e14-a0fc-eaec0f0d76be`::Granted request >Thread-40::DEBUG::2012-11-29 15:03:44,971::task::794::TaskManager.Task::(resourceAcquired) Task=`cac04049-cc39-4e1b-b077-56cc9a8b0e22`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-40::DEBUG::2012-11-29 15:03:44,971::task::957::TaskManager.Task::(_decref) Task=`cac04049-cc39-4e1b-b077-56cc9a8b0e22`::ref 1 aborting False >Thread-40::INFO::2012-11-29 15:03:44,972::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '459339259904', 'disktotal': '485945925632', 'mdafree': 0}} >Thread-40::DEBUG::2012-11-29 15:03:44,972::task::1151::TaskManager.Task::(prepare) Task=`cac04049-cc39-4e1b-b077-56cc9a8b0e22`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '459339259904', 'disktotal': '485945925632', 'mdafree': 0}} >Thread-40::DEBUG::2012-11-29 15:03:44,972::task::568::TaskManager.Task::(_updateState) Task=`cac04049-cc39-4e1b-b077-56cc9a8b0e22`::moving from state preparing -> state finished >Thread-40::DEBUG::2012-11-29 15:03:44,972::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-40::DEBUG::2012-11-29 15:03:44,972::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2012-11-29 15:03:44,973::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-40::DEBUG::2012-11-29 15:03:44,973::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-40::DEBUG::2012-11-29 15:03:44,973::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-40::DEBUG::2012-11-29 15:03:44,973::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-40::DEBUG::2012-11-29 15:03:44,974::task::957::TaskManager.Task::(_decref) Task=`cac04049-cc39-4e1b-b077-56cc9a8b0e22`::ref 0 aborting False >Thread-41::DEBUG::2012-11-29 15:03:45,239::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-41::DEBUG::2012-11-29 15:03:45,240::task::568::TaskManager.Task::(_updateState) Task=`1bbf1874-a932-4481-a455-cbb9df958145`::moving from state init -> state preparing >Thread-41::INFO::2012-11-29 15:03:45,240::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '372edb4d-9429-4285-88aa-859409c5e0e3', 'port': ''}], options=None) >Thread-41::INFO::2012-11-29 15:03:45,240::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-41::DEBUG::2012-11-29 15:03:45,240::task::1151::TaskManager.Task::(prepare) Task=`1bbf1874-a932-4481-a455-cbb9df958145`::finished: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-41::DEBUG::2012-11-29 15:03:45,240::task::568::TaskManager.Task::(_updateState) Task=`1bbf1874-a932-4481-a455-cbb9df958145`::moving from state preparing -> state finished >Thread-41::DEBUG::2012-11-29 15:03:45,241::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-41::DEBUG::2012-11-29 15:03:45,241::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-41::DEBUG::2012-11-29 15:03:45,241::task::957::TaskManager.Task::(_decref) Task=`1bbf1874-a932-4481-a455-cbb9df958145`::ref 0 aborting False >Thread-42::DEBUG::2012-11-29 15:03:45,264::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-42::DEBUG::2012-11-29 15:03:45,264::task::568::TaskManager.Task::(_updateState) Task=`1f758f76-2dd6-4cd6-9369-936a79c1a0b1`::moving from state init -> state preparing >Thread-42::INFO::2012-11-29 15:03:45,264::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '372edb4d-9429-4285-88aa-859409c5e0e3', 'port': ''}], options=None) >Thread-42::INFO::2012-11-29 15:03:45,269::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-42::DEBUG::2012-11-29 15:03:45,269::task::1151::TaskManager.Task::(prepare) Task=`1f758f76-2dd6-4cd6-9369-936a79c1a0b1`::finished: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-42::DEBUG::2012-11-29 15:03:45,270::task::568::TaskManager.Task::(_updateState) Task=`1f758f76-2dd6-4cd6-9369-936a79c1a0b1`::moving from state preparing -> state finished >Thread-42::DEBUG::2012-11-29 15:03:45,270::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-42::DEBUG::2012-11-29 15:03:45,270::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-42::DEBUG::2012-11-29 15:03:45,270::task::957::TaskManager.Task::(_decref) Task=`1f758f76-2dd6-4cd6-9369-936a79c1a0b1`::ref 0 aborting False >Thread-43::DEBUG::2012-11-29 15:03:45,303::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-43::DEBUG::2012-11-29 15:03:45,303::task::568::TaskManager.Task::(_updateState) Task=`846fbb35-54e4-4187-994f-9a4d806b5a7e`::moving from state init -> state preparing >Thread-43::INFO::2012-11-29 15:03:45,304::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', poolName='RestDataCenter_LOCAL', masterDom='4d25f33e-850f-4088-8f0b-e9cbc8276313', domList=['4d25f33e-850f-4088-8f0b-e9cbc8276313'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-43::INFO::2012-11-29 15:03:45,304::fileSD::302::Storage.StorageDomain::(validate) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-43::DEBUG::2012-11-29 15:03:45,305::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=39fd13839ff0bd029089531529969c1c5df9d713'] >Thread-43::DEBUG::2012-11-29 15:03:45,306::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`102fb58b-da2f-4b77-b212-6c86a6596d02`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-43::DEBUG::2012-11-29 15:03:45,306::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-43::DEBUG::2012-11-29 15:03:45,306::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-43::DEBUG::2012-11-29 15:03:45,306::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`102fb58b-da2f-4b77-b212-6c86a6596d02`::Granted request >Thread-43::DEBUG::2012-11-29 15:03:45,307::task::794::TaskManager.Task::(resourceAcquired) Task=`846fbb35-54e4-4187-994f-9a4d806b5a7e`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (exclusive) >Thread-43::DEBUG::2012-11-29 15:03:45,307::task::957::TaskManager.Task::(_decref) Task=`846fbb35-54e4-4187-994f-9a4d806b5a7e`::ref 1 aborting False >Thread-43::DEBUG::2012-11-29 15:03:45,307::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`d66e63dd-2b99-40bf-b7a9-a3db412ed62a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-43::DEBUG::2012-11-29 15:03:45,307::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'exclusive' >Thread-43::DEBUG::2012-11-29 15:03:45,307::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'exclusive' (1 active user) >Thread-43::DEBUG::2012-11-29 15:03:45,308::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`d66e63dd-2b99-40bf-b7a9-a3db412ed62a`::Granted request >Thread-43::DEBUG::2012-11-29 15:03:45,308::task::794::TaskManager.Task::(resourceAcquired) Task=`846fbb35-54e4-4187-994f-9a4d806b5a7e`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (exclusive) >Thread-43::DEBUG::2012-11-29 15:03:45,308::task::957::TaskManager.Task::(_decref) Task=`846fbb35-54e4-4187-994f-9a4d806b5a7e`::ref 1 aborting False >Thread-43::INFO::2012-11-29 15:03:45,308::sp::544::Storage.StoragePool::(create) spUUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f poolName=RestDataCenter_LOCAL master_sd=4d25f33e-850f-4088-8f0b-e9cbc8276313 domList=['4d25f33e-850f-4088-8f0b-e9cbc8276313'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-43::INFO::2012-11-29 15:03:45,308::fileSD::302::Storage.StorageDomain::(validate) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-43::DEBUG::2012-11-29 15:03:45,310::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=39fd13839ff0bd029089531529969c1c5df9d713'] >Thread-43::DEBUG::2012-11-29 15:03:45,311::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=39fd13839ff0bd029089531529969c1c5df9d713'] >Thread-43::DEBUG::2012-11-29 15:03:45,311::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-43::DEBUG::2012-11-29 15:03:45,312::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-43::DEBUG::2012-11-29 15:03:45,312::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=c42cc4b0772252bef4d49f13dc0f71df5cad5c45'] >Thread-43::DEBUG::2012-11-29 15:03:45,313::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-43::DEBUG::2012-11-29 15:03:45,313::safelease::94::ClusterLock::(acquire) Acquiring cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-43::DEBUG::2012-11-29 15:03:45,314::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c1 -n0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 4d25f33e-850f-4088-8f0b-e9cbc8276313 1000 5 /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Thread-44::DEBUG::2012-11-29 15:03:45,829::task::568::TaskManager.Task::(_updateState) Task=`3aa9de42-90d1-47a9-b188-06e6b93dd36b`::moving from state init -> state preparing >Thread-44::INFO::2012-11-29 15:03:45,829::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-44::INFO::2012-11-29 15:03:45,829::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-44::DEBUG::2012-11-29 15:03:45,830::task::1151::TaskManager.Task::(prepare) Task=`3aa9de42-90d1-47a9-b188-06e6b93dd36b`::finished: {} >Thread-44::DEBUG::2012-11-29 15:03:45,830::task::568::TaskManager.Task::(_updateState) Task=`3aa9de42-90d1-47a9-b188-06e6b93dd36b`::moving from state preparing -> state finished >Thread-44::DEBUG::2012-11-29 15:03:45,830::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2012-11-29 15:03:45,830::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2012-11-29 15:03:45,830::task::957::TaskManager.Task::(_decref) Task=`3aa9de42-90d1-47a9-b188-06e6b93dd36b`::ref 0 aborting False >Thread-50::DEBUG::2012-11-29 15:03:56,040::task::568::TaskManager.Task::(_updateState) Task=`854a5f9d-6b80-4f11-aa20-3f9b30308816`::moving from state init -> state preparing >Thread-50::INFO::2012-11-29 15:03:56,040::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-50::INFO::2012-11-29 15:03:56,040::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-50::DEBUG::2012-11-29 15:03:56,040::task::1151::TaskManager.Task::(prepare) Task=`854a5f9d-6b80-4f11-aa20-3f9b30308816`::finished: {} >Thread-50::DEBUG::2012-11-29 15:03:56,040::task::568::TaskManager.Task::(_updateState) Task=`854a5f9d-6b80-4f11-aa20-3f9b30308816`::moving from state preparing -> state finished >Thread-50::DEBUG::2012-11-29 15:03:56,040::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-50::DEBUG::2012-11-29 15:03:56,041::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-50::DEBUG::2012-11-29 15:03:56,041::task::957::TaskManager.Task::(_decref) Task=`854a5f9d-6b80-4f11-aa20-3f9b30308816`::ref 0 aborting False >Thread-43::DEBUG::2012-11-29 15:04:05,415::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-43::DEBUG::2012-11-29 15:04:05,415::safelease::109::ClusterLock::(acquire) Clustered lock acquired successfully >Thread-43::INFO::2012-11-29 15:04:05,415::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID b39553bd-b94c-42e1-8e06-40483d5f3c3f on sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-43::DEBUG::2012-11-29 15:04:05,416::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-43::DEBUG::2012-11-29 15:04:05,416::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-43::DEBUG::2012-11-29 15:04:05,418::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=c42cc4b0772252bef4d49f13dc0f71df5cad5c45'] >Thread-43::DEBUG::2012-11-29 15:04:05,418::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-43::DEBUG::2012-11-29 15:04:05,419::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-43::DEBUG::2012-11-29 15:04:05,419::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-43::DEBUG::2012-11-29 15:04:05,419::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-43::DEBUG::2012-11-29 15:04:05,419::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=fdf826fc02fcbc6cdd7ad2eef0e215fe402af874'] >Thread-43::DEBUG::2012-11-29 15:04:05,421::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-43::DEBUG::2012-11-29 15:04:05,421::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 verified, version 1 >Thread-43::DEBUG::2012-11-29 15:04:05,421::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-43::DEBUG::2012-11-29 15:04:05,421::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-43::DEBUG::2012-11-29 15:04:05,423::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=fdf826fc02fcbc6cdd7ad2eef0e215fe402af874'] >Thread-43::DEBUG::2012-11-29 15:04:05,424::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b39553bd-b94c-42e1-8e06-40483d5f3c3f` started monitoring domain `4d25f33e-850f-4088-8f0b-e9cbc8276313` >Thread-56::DEBUG::2012-11-29 15:04:05,424::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-43::DEBUG::2012-11-29 15:04:05,425::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-43::WARNING::2012-11-29 15:04:05,427::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f already exists >Thread-43::DEBUG::2012-11-29 15:04:05,430::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-43::DEBUG::2012-11-29 15:04:05,433::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-43::DEBUG::2012-11-29 15:04:05,575::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-43::DEBUG::2012-11-29 15:04:05,575::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-43::INFO::2012-11-29 15:04:05,577::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 to /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-43::INFO::2012-11-29 15:04:05,578::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 to /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd >Thread-43::INFO::2012-11-29 15:04:05,578::safelease::119::ClusterLock::(release) Releasing cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-43::DEBUG::2012-11-29 15:04:05,578::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 4d25f33e-850f-4088-8f0b-e9cbc8276313' (cwd /usr/libexec/vdsm) >Thread-58::DEBUG::2012-11-29 15:04:06,253::task::568::TaskManager.Task::(_updateState) Task=`043efebc-e85f-4ae0-9d45-708540343113`::moving from state init -> state preparing >Thread-58::INFO::2012-11-29 15:04:06,253::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-58::INFO::2012-11-29 15:04:06,253::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-58::DEBUG::2012-11-29 15:04:06,253::task::1151::TaskManager.Task::(prepare) Task=`043efebc-e85f-4ae0-9d45-708540343113`::finished: {} >Thread-58::DEBUG::2012-11-29 15:04:06,254::task::568::TaskManager.Task::(_updateState) Task=`043efebc-e85f-4ae0-9d45-708540343113`::moving from state preparing -> state finished >Thread-58::DEBUG::2012-11-29 15:04:06,254::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-58::DEBUG::2012-11-29 15:04:06,254::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-58::DEBUG::2012-11-29 15:04:06,254::task::957::TaskManager.Task::(_decref) Task=`043efebc-e85f-4ae0-9d45-708540343113`::ref 0 aborting False >Thread-43::DEBUG::2012-11-29 15:04:06,657::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-43::DEBUG::2012-11-29 15:04:06,658::safelease::126::ClusterLock::(release) Cluster lock released successfully >Thread-56::DEBUG::2012-11-29 15:04:06,658::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-43::INFO::2012-11-29 15:04:06,658::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-43::DEBUG::2012-11-29 15:04:06,658::task::1151::TaskManager.Task::(prepare) Task=`846fbb35-54e4-4187-994f-9a4d806b5a7e`::finished: True >Thread-43::DEBUG::2012-11-29 15:04:06,659::task::568::TaskManager.Task::(_updateState) Task=`846fbb35-54e4-4187-994f-9a4d806b5a7e`::moving from state preparing -> state finished >Thread-43::DEBUG::2012-11-29 15:04:06,659::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>, 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2012-11-29 15:04:06,659::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2012-11-29 15:04:06,659::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-43::DEBUG::2012-11-29 15:04:06,660::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-43::DEBUG::2012-11-29 15:04:06,660::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2012-11-29 15:04:06,660::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-43::DEBUG::2012-11-29 15:04:06,660::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-43::DEBUG::2012-11-29 15:04:06,660::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-43::DEBUG::2012-11-29 15:04:06,661::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2012-11-29 15:04:06,661::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-43::DEBUG::2012-11-29 15:04:06,661::task::957::TaskManager.Task::(_decref) Task=`846fbb35-54e4-4187-994f-9a4d806b5a7e`::ref 0 aborting False >Thread-60::DEBUG::2012-11-29 15:04:06,748::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-60::DEBUG::2012-11-29 15:04:06,749::task::568::TaskManager.Task::(_updateState) Task=`532b7cc9-940e-4cf8-b9e8-930b9ba2e52d`::moving from state init -> state preparing >Thread-60::INFO::2012-11-29 15:04:06,749::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '372edb4d-9429-4285-88aa-859409c5e0e3', 'port': ''}], options=None) >Thread-60::INFO::2012-11-29 15:04:06,749::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-60::DEBUG::2012-11-29 15:04:06,749::task::1151::TaskManager.Task::(prepare) Task=`532b7cc9-940e-4cf8-b9e8-930b9ba2e52d`::finished: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-60::DEBUG::2012-11-29 15:04:06,750::task::568::TaskManager.Task::(_updateState) Task=`532b7cc9-940e-4cf8-b9e8-930b9ba2e52d`::moving from state preparing -> state finished >Thread-60::DEBUG::2012-11-29 15:04:06,750::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2012-11-29 15:04:06,750::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2012-11-29 15:04:06,750::task::957::TaskManager.Task::(_decref) Task=`532b7cc9-940e-4cf8-b9e8-930b9ba2e52d`::ref 0 aborting False >Thread-61::DEBUG::2012-11-29 15:04:06,783::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-61::DEBUG::2012-11-29 15:04:06,784::task::568::TaskManager.Task::(_updateState) Task=`8180e99a-47d9-4fce-a00b-edf13d4908e0`::moving from state init -> state preparing >Thread-61::INFO::2012-11-29 15:04:06,784::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '372edb4d-9429-4285-88aa-859409c5e0e3', 'port': ''}], options=None) >Thread-61::INFO::2012-11-29 15:04:06,789::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-61::DEBUG::2012-11-29 15:04:06,789::task::1151::TaskManager.Task::(prepare) Task=`8180e99a-47d9-4fce-a00b-edf13d4908e0`::finished: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-61::DEBUG::2012-11-29 15:04:06,789::task::568::TaskManager.Task::(_updateState) Task=`8180e99a-47d9-4fce-a00b-edf13d4908e0`::moving from state preparing -> state finished >Thread-61::DEBUG::2012-11-29 15:04:06,789::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-61::DEBUG::2012-11-29 15:04:06,789::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-61::DEBUG::2012-11-29 15:04:06,790::task::957::TaskManager.Task::(_decref) Task=`8180e99a-47d9-4fce-a00b-edf13d4908e0`::ref 0 aborting False >Thread-62::DEBUG::2012-11-29 15:04:06,874::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-62::DEBUG::2012-11-29 15:04:06,875::task::568::TaskManager.Task::(_updateState) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::moving from state init -> state preparing >Thread-62::INFO::2012-11-29 15:04:06,875::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-62::ERROR::2012-11-29 15:04:06,875::task::833::TaskManager.Task::(_setError) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 597, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 310, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('b39553bd-b94c-42e1-8e06-40483d5f3c3f',) >Thread-62::DEBUG::2012-11-29 15:04:06,899::task::852::TaskManager.Task::(_run) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::Task._run: 4f207ef4-66bf-46e6-8fd3-306a9e87f248 ('b39553bd-b94c-42e1-8e06-40483d5f3c3f',) {} failed - stopping task >Thread-62::DEBUG::2012-11-29 15:04:06,899::task::1177::TaskManager.Task::(stop) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::stopping in state preparing (force False) >Thread-62::DEBUG::2012-11-29 15:04:06,899::task::957::TaskManager.Task::(_decref) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::ref 1 aborting True >Thread-62::INFO::2012-11-29 15:04:06,900::task::1134::TaskManager.Task::(prepare) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-62::DEBUG::2012-11-29 15:04:06,900::task::1139::TaskManager.Task::(prepare) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::Prepare: aborted: Unknown pool id, pool not connected >Thread-62::DEBUG::2012-11-29 15:04:06,900::task::957::TaskManager.Task::(_decref) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::ref 0 aborting True >Thread-62::DEBUG::2012-11-29 15:04:06,900::task::892::TaskManager.Task::(_doAbort) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::Task._doAbort: force False >Thread-62::DEBUG::2012-11-29 15:04:06,900::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::DEBUG::2012-11-29 15:04:06,901::task::568::TaskManager.Task::(_updateState) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::moving from state preparing -> state aborting >Thread-62::DEBUG::2012-11-29 15:04:06,901::task::523::TaskManager.Task::(__state_aborting) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::_aborting: recover policy none >Thread-62::DEBUG::2012-11-29 15:04:06,901::task::568::TaskManager.Task::(_updateState) Task=`4f207ef4-66bf-46e6-8fd3-306a9e87f248`::moving from state aborting -> state failed >Thread-62::DEBUG::2012-11-29 15:04:06,901::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-62::DEBUG::2012-11-29 15:04:06,901::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::ERROR::2012-11-29 15:04:06,901::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('b39553bd-b94c-42e1-8e06-40483d5f3c3f',)", 'code': 309}} >Thread-63::DEBUG::2012-11-29 15:04:06,984::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-63::DEBUG::2012-11-29 15:04:06,984::task::568::TaskManager.Task::(_updateState) Task=`6654226d-7904-4ead-ab4f-5ca7fa2e2c35`::moving from state init -> state preparing >Thread-63::INFO::2012-11-29 15:04:06,985::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', hostID=1, scsiKey='b39553bd-b94c-42e1-8e06-40483d5f3c3f', msdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', masterVersion=1, options=None) >Thread-63::DEBUG::2012-11-29 15:04:06,985::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`b6eba7df-e91d-4d51-a307-a6ef6a5dfc95`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-63::DEBUG::2012-11-29 15:04:06,985::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-63::DEBUG::2012-11-29 15:04:06,985::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-63::DEBUG::2012-11-29 15:04:06,986::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`b6eba7df-e91d-4d51-a307-a6ef6a5dfc95`::Granted request >Thread-63::INFO::2012-11-29 15:04:06,986::sp::628::Storage.StoragePool::(connect) Connect host #1 to the storage pool b39553bd-b94c-42e1-8e06-40483d5f3c3f with master domain: 4d25f33e-850f-4088-8f0b-e9cbc8276313 (ver = 1) >Thread-63::DEBUG::2012-11-29 15:04:06,986::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:06,987::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:06,987::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:06,987::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:06,987::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:06,988::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:06,988::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-63::DEBUG::2012-11-29 15:04:06,988::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-63::DEBUG::2012-11-29 15:04:06,988::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-63::DEBUG::2012-11-29 15:04:06,989::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-63::DEBUG::2012-11-29 15:04:06,989::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-63::DEBUG::2012-11-29 15:04:07,004::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::DEBUG::2012-11-29 15:04:07,005::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-63::DEBUG::2012-11-29 15:04:07,007::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-63::DEBUG::2012-11-29 15:04:07,009::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-63::DEBUG::2012-11-29 15:04:07,011::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-63::DEBUG::2012-11-29 15:04:07,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-63::DEBUG::2012-11-29 15:04:07,015::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-63::DEBUG::2012-11-29 15:04:07,017::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-63::DEBUG::2012-11-29 15:04:07,019::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-63::DEBUG::2012-11-29 15:04:07,021::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-63::DEBUG::2012-11-29 15:04:09,025::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-63::DEBUG::2012-11-29 15:04:09,087::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::DEBUG::2012-11-29 15:04:09,088::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,088::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,089::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,089::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,089::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,090::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,090::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-63::DEBUG::2012-11-29 15:04:09,090::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,091::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4d25f33e-850f-4088-8f0b-e9cbc8276313' (cwd None) >Thread-63::DEBUG::2012-11-29 15:04:09,243::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found\n'; <rc> = 5 >Thread-63::WARNING::2012-11-29 15:04:09,244::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found'] >Thread-63::DEBUG::2012-11-29 15:04:09,244::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,246::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-63::DEBUG::2012-11-29 15:04:09,247::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-63::DEBUG::2012-11-29 15:04:09,254::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=fdf826fc02fcbc6cdd7ad2eef0e215fe402af874'] >Thread-63::DEBUG::2012-11-29 15:04:09,256::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-63::WARNING::2012-11-29 15:04:09,256::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS already registered >Thread-63::WARNING::2012-11-29 15:04:09,256::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_volumeNS already registered >Thread-63::DEBUG::2012-11-29 15:04:09,256::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 verified, version 1 >Thread-63::DEBUG::2012-11-29 15:04:09,257::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-63::DEBUG::2012-11-29 15:04:09,257::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-63::DEBUG::2012-11-29 15:04:09,258::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=fdf826fc02fcbc6cdd7ad2eef0e215fe402af874'] >Thread-63::DEBUG::2012-11-29 15:04:09,259::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b39553bd-b94c-42e1-8e06-40483d5f3c3f` started monitoring domain `4d25f33e-850f-4088-8f0b-e9cbc8276313` >Thread-66::DEBUG::2012-11-29 15:04:09,259::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-63::DEBUG::2012-11-29 15:04:09,260::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-63::WARNING::2012-11-29 15:04:09,261::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f already exists >Thread-63::DEBUG::2012-11-29 15:04:09,262::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-63::DEBUG::2012-11-29 15:04:09,265::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-63::DEBUG::2012-11-29 15:04:09,408::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-63::DEBUG::2012-11-29 15:04:09,409::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-63::INFO::2012-11-29 15:04:09,411::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 to /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-63::INFO::2012-11-29 15:04:09,411::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 to /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd >Thread-63::DEBUG::2012-11-29 15:04:09,411::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-63::DEBUG::2012-11-29 15:04:09,412::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-63::DEBUG::2012-11-29 15:04:09,412::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-63::DEBUG::2012-11-29 15:04:09,412::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-63::INFO::2012-11-29 15:04:09,412::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-63::DEBUG::2012-11-29 15:04:09,413::task::1151::TaskManager.Task::(prepare) Task=`6654226d-7904-4ead-ab4f-5ca7fa2e2c35`::finished: True >Thread-63::DEBUG::2012-11-29 15:04:09,413::task::568::TaskManager.Task::(_updateState) Task=`6654226d-7904-4ead-ab4f-5ca7fa2e2c35`::moving from state preparing -> state finished >Thread-63::DEBUG::2012-11-29 15:04:09,413::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-63::DEBUG::2012-11-29 15:04:09,413::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-63::DEBUG::2012-11-29 15:04:09,413::task::957::TaskManager.Task::(_decref) Task=`6654226d-7904-4ead-ab4f-5ca7fa2e2c35`::ref 0 aborting False >Thread-68::DEBUG::2012-11-29 15:04:09,442::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-68::DEBUG::2012-11-29 15:04:09,442::task::568::TaskManager.Task::(_updateState) Task=`62127b7f-4444-4bb6-9df9-818e0e442342`::moving from state init -> state preparing >Thread-68::INFO::2012-11-29 15:04:09,442::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-68::INFO::2012-11-29 15:04:09,443::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-68::DEBUG::2012-11-29 15:04:09,443::task::1151::TaskManager.Task::(prepare) Task=`62127b7f-4444-4bb6-9df9-818e0e442342`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-68::DEBUG::2012-11-29 15:04:09,443::task::568::TaskManager.Task::(_updateState) Task=`62127b7f-4444-4bb6-9df9-818e0e442342`::moving from state preparing -> state finished >Thread-68::DEBUG::2012-11-29 15:04:09,443::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-68::DEBUG::2012-11-29 15:04:09,443::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-68::DEBUG::2012-11-29 15:04:09,443::task::957::TaskManager.Task::(_decref) Task=`62127b7f-4444-4bb6-9df9-818e0e442342`::ref 0 aborting False >Thread-69::DEBUG::2012-11-29 15:04:09,491::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-69::DEBUG::2012-11-29 15:04:09,491::task::568::TaskManager.Task::(_updateState) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::moving from state init -> state preparing >Thread-69::INFO::2012-11-29 15:04:09,491::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-69::DEBUG::2012-11-29 15:04:09,492::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`a16efcc0-a23a-410b-8fd1-f989cd8693e0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-69::DEBUG::2012-11-29 15:04:09,492::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-69::DEBUG::2012-11-29 15:04:09,492::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-69::DEBUG::2012-11-29 15:04:09,492::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`a16efcc0-a23a-410b-8fd1-f989cd8693e0`::Granted request >Thread-69::DEBUG::2012-11-29 15:04:09,493::task::794::TaskManager.Task::(resourceAcquired) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (exclusive) >Thread-69::DEBUG::2012-11-29 15:04:09,493::task::957::TaskManager.Task::(_decref) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::ref 1 aborting False >Thread-69::INFO::2012-11-29 15:04:09,494::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-69::DEBUG::2012-11-29 15:04:09,494::task::1146::TaskManager.Task::(prepare) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::Prepare: 1 jobs exist, move to acquiring >Thread-69::DEBUG::2012-11-29 15:04:09,494::task::568::TaskManager.Task::(_updateState) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::moving from state preparing -> state acquiring >Thread-69::DEBUG::2012-11-29 15:04:09,494::task::568::TaskManager.Task::(_updateState) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::moving from state acquiring -> state queued >Thread-69::DEBUG::2012-11-29 15:04:09,494::taskManager::50::TaskManager::(_queueTask) queuing task: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-69::DEBUG::2012-11-29 15:04:09,495::taskManager::56::TaskManager::(_queueTask) task queued: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-5::DEBUG::2012-11-29 15:04:09,495::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-69::DEBUG::2012-11-29 15:04:09,496::task::1148::TaskManager.Task::(prepare) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::returning >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,496::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad running: <bound method Task.commit of <storage.task.Task instance at 0x7fc0fc26c2d8>> with: None >Thread-69::DEBUG::2012-11-29 15:04:09,497::task::957::TaskManager.Task::(_decref) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::ref 0 aborting False >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,497::task::1159::TaskManager.Task::(commit) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::committing task: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,498::task::568::TaskManager.Task::(_updateState) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::moving from state queued -> state running >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,499::task::872::TaskManager.Task::(_runJobs) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fc0fc25a790>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,500::task::304::TaskManager.Task::(run) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fc0fc25a790>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,500::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,500::misc::1027::SamplingMethod::(__call__) Got in to sampling method >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,502::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=fdf826fc02fcbc6cdd7ad2eef0e215fe402af874'] >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,502::misc::1035::SamplingMethod::(__call__) Returning last result >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,504::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=fdf826fc02fcbc6cdd7ad2eef0e215fe402af874'] >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,504::safelease::94::ClusterLock::(acquire) Acquiring cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:09,505::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c1 -n0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 4d25f33e-850f-4088-8f0b-e9cbc8276313 1 5 /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Thread-71::DEBUG::2012-11-29 15:04:10,534::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-71::DEBUG::2012-11-29 15:04:10,535::task::568::TaskManager.Task::(_updateState) Task=`fb3b6276-159f-4878-bad1-533593523274`::moving from state init -> state preparing >Thread-71::INFO::2012-11-29 15:04:10,535::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-71::DEBUG::2012-11-29 15:04:10,535::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-71::DEBUG::2012-11-29 15:04:10,536::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-71::INFO::2012-11-29 15:04:10,536::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-71::DEBUG::2012-11-29 15:04:10,536::task::1151::TaskManager.Task::(prepare) Task=`fb3b6276-159f-4878-bad1-533593523274`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-71::DEBUG::2012-11-29 15:04:10,536::task::568::TaskManager.Task::(_updateState) Task=`fb3b6276-159f-4878-bad1-533593523274`::moving from state preparing -> state finished >Thread-71::DEBUG::2012-11-29 15:04:10,536::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-71::DEBUG::2012-11-29 15:04:10,537::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-71::DEBUG::2012-11-29 15:04:10,537::task::957::TaskManager.Task::(_decref) Task=`fb3b6276-159f-4878-bad1-533593523274`::ref 0 aborting False >Thread-72::DEBUG::2012-11-29 15:04:11,568::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-72::DEBUG::2012-11-29 15:04:11,568::task::568::TaskManager.Task::(_updateState) Task=`cbc29411-dfaa-474e-bada-5a556649601c`::moving from state init -> state preparing >Thread-72::INFO::2012-11-29 15:04:11,569::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-72::DEBUG::2012-11-29 15:04:11,569::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-72::DEBUG::2012-11-29 15:04:11,569::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-72::INFO::2012-11-29 15:04:11,569::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-72::DEBUG::2012-11-29 15:04:11,569::task::1151::TaskManager.Task::(prepare) Task=`cbc29411-dfaa-474e-bada-5a556649601c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-72::DEBUG::2012-11-29 15:04:11,570::task::568::TaskManager.Task::(_updateState) Task=`cbc29411-dfaa-474e-bada-5a556649601c`::moving from state preparing -> state finished >Thread-72::DEBUG::2012-11-29 15:04:11,570::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-72::DEBUG::2012-11-29 15:04:11,570::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-72::DEBUG::2012-11-29 15:04:11,570::task::957::TaskManager.Task::(_decref) Task=`cbc29411-dfaa-474e-bada-5a556649601c`::ref 0 aborting False >Thread-74::DEBUG::2012-11-29 15:04:12,614::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-74::DEBUG::2012-11-29 15:04:12,615::task::568::TaskManager.Task::(_updateState) Task=`4939204a-40fb-4345-b24c-3b7d6093d9d1`::moving from state init -> state preparing >Thread-74::INFO::2012-11-29 15:04:12,615::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-74::DEBUG::2012-11-29 15:04:12,615::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-74::DEBUG::2012-11-29 15:04:12,615::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-74::INFO::2012-11-29 15:04:12,615::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-74::DEBUG::2012-11-29 15:04:12,615::task::1151::TaskManager.Task::(prepare) Task=`4939204a-40fb-4345-b24c-3b7d6093d9d1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-74::DEBUG::2012-11-29 15:04:12,616::task::568::TaskManager.Task::(_updateState) Task=`4939204a-40fb-4345-b24c-3b7d6093d9d1`::moving from state preparing -> state finished >Thread-74::DEBUG::2012-11-29 15:04:12,616::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-74::DEBUG::2012-11-29 15:04:12,616::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-74::DEBUG::2012-11-29 15:04:12,616::task::957::TaskManager.Task::(_decref) Task=`4939204a-40fb-4345-b24c-3b7d6093d9d1`::ref 0 aborting False >Thread-75::DEBUG::2012-11-29 15:04:13,655::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-75::DEBUG::2012-11-29 15:04:13,655::task::568::TaskManager.Task::(_updateState) Task=`81aaa8a1-0cbf-43cc-a549-09472b289435`::moving from state init -> state preparing >Thread-75::INFO::2012-11-29 15:04:13,656::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-75::DEBUG::2012-11-29 15:04:13,656::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-75::DEBUG::2012-11-29 15:04:13,656::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-75::INFO::2012-11-29 15:04:13,656::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-75::DEBUG::2012-11-29 15:04:13,656::task::1151::TaskManager.Task::(prepare) Task=`81aaa8a1-0cbf-43cc-a549-09472b289435`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-75::DEBUG::2012-11-29 15:04:13,656::task::568::TaskManager.Task::(_updateState) Task=`81aaa8a1-0cbf-43cc-a549-09472b289435`::moving from state preparing -> state finished >Thread-75::DEBUG::2012-11-29 15:04:13,657::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-75::DEBUG::2012-11-29 15:04:13,657::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-75::DEBUG::2012-11-29 15:04:13,657::task::957::TaskManager.Task::(_decref) Task=`81aaa8a1-0cbf-43cc-a549-09472b289435`::ref 0 aborting False >Thread-77::DEBUG::2012-11-29 15:04:14,686::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-77::DEBUG::2012-11-29 15:04:14,687::task::568::TaskManager.Task::(_updateState) Task=`9b42d88e-c9f8-46ce-b975-9471c3c87977`::moving from state init -> state preparing >Thread-77::INFO::2012-11-29 15:04:14,687::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-77::DEBUG::2012-11-29 15:04:14,687::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-77::DEBUG::2012-11-29 15:04:14,687::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-77::INFO::2012-11-29 15:04:14,687::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-77::DEBUG::2012-11-29 15:04:14,687::task::1151::TaskManager.Task::(prepare) Task=`9b42d88e-c9f8-46ce-b975-9471c3c87977`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-77::DEBUG::2012-11-29 15:04:14,688::task::568::TaskManager.Task::(_updateState) Task=`9b42d88e-c9f8-46ce-b975-9471c3c87977`::moving from state preparing -> state finished >Thread-77::DEBUG::2012-11-29 15:04:14,688::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-77::DEBUG::2012-11-29 15:04:14,688::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-77::DEBUG::2012-11-29 15:04:14,688::task::957::TaskManager.Task::(_decref) Task=`9b42d88e-c9f8-46ce-b975-9471c3c87977`::ref 0 aborting False >Thread-78::DEBUG::2012-11-29 15:04:15,718::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-78::DEBUG::2012-11-29 15:04:15,718::task::568::TaskManager.Task::(_updateState) Task=`0401ccff-52be-4aa1-8761-cfdf72ae7fa2`::moving from state init -> state preparing >Thread-78::INFO::2012-11-29 15:04:15,719::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-78::DEBUG::2012-11-29 15:04:15,719::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-78::DEBUG::2012-11-29 15:04:15,719::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-78::INFO::2012-11-29 15:04:15,719::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-78::DEBUG::2012-11-29 15:04:15,719::task::1151::TaskManager.Task::(prepare) Task=`0401ccff-52be-4aa1-8761-cfdf72ae7fa2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-78::DEBUG::2012-11-29 15:04:15,719::task::568::TaskManager.Task::(_updateState) Task=`0401ccff-52be-4aa1-8761-cfdf72ae7fa2`::moving from state preparing -> state finished >Thread-78::DEBUG::2012-11-29 15:04:15,720::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-78::DEBUG::2012-11-29 15:04:15,720::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2012-11-29 15:04:15,720::task::957::TaskManager.Task::(_decref) Task=`0401ccff-52be-4aa1-8761-cfdf72ae7fa2`::ref 0 aborting False >Thread-79::DEBUG::2012-11-29 15:04:16,464::task::568::TaskManager.Task::(_updateState) Task=`62cb3b03-c9b8-4cab-9129-b4d00c2ebe96`::moving from state init -> state preparing >Thread-79::INFO::2012-11-29 15:04:16,464::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-79::INFO::2012-11-29 15:04:16,465::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00691390037537', 'lastCheck': '7.2', 'code': 0, 'valid': True}} >Thread-79::DEBUG::2012-11-29 15:04:16,465::task::1151::TaskManager.Task::(prepare) Task=`62cb3b03-c9b8-4cab-9129-b4d00c2ebe96`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00691390037537', 'lastCheck': '7.2', 'code': 0, 'valid': True}} >Thread-79::DEBUG::2012-11-29 15:04:16,465::task::568::TaskManager.Task::(_updateState) Task=`62cb3b03-c9b8-4cab-9129-b4d00c2ebe96`::moving from state preparing -> state finished >Thread-79::DEBUG::2012-11-29 15:04:16,465::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-79::DEBUG::2012-11-29 15:04:16,465::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-79::DEBUG::2012-11-29 15:04:16,465::task::957::TaskManager.Task::(_decref) Task=`62cb3b03-c9b8-4cab-9129-b4d00c2ebe96`::ref 0 aborting False >Thread-81::DEBUG::2012-11-29 15:04:16,749::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-81::DEBUG::2012-11-29 15:04:16,749::task::568::TaskManager.Task::(_updateState) Task=`eb71896d-0d68-4ba0-b6d0-4e3a576ff3ce`::moving from state init -> state preparing >Thread-81::INFO::2012-11-29 15:04:16,749::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-81::DEBUG::2012-11-29 15:04:16,749::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-81::DEBUG::2012-11-29 15:04:16,749::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-81::INFO::2012-11-29 15:04:16,749::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-81::DEBUG::2012-11-29 15:04:16,750::task::1151::TaskManager.Task::(prepare) Task=`eb71896d-0d68-4ba0-b6d0-4e3a576ff3ce`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-81::DEBUG::2012-11-29 15:04:16,750::task::568::TaskManager.Task::(_updateState) Task=`eb71896d-0d68-4ba0-b6d0-4e3a576ff3ce`::moving from state preparing -> state finished >Thread-81::DEBUG::2012-11-29 15:04:16,750::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2012-11-29 15:04:16,750::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2012-11-29 15:04:16,750::task::957::TaskManager.Task::(_decref) Task=`eb71896d-0d68-4ba0-b6d0-4e3a576ff3ce`::ref 0 aborting False >Thread-82::DEBUG::2012-11-29 15:04:17,779::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-82::DEBUG::2012-11-29 15:04:17,779::task::568::TaskManager.Task::(_updateState) Task=`31c3241c-65e6-4e47-83eb-08d9fc31bd47`::moving from state init -> state preparing >Thread-82::INFO::2012-11-29 15:04:17,780::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-82::DEBUG::2012-11-29 15:04:17,780::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-82::DEBUG::2012-11-29 15:04:17,780::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-82::INFO::2012-11-29 15:04:17,780::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-82::DEBUG::2012-11-29 15:04:17,780::task::1151::TaskManager.Task::(prepare) Task=`31c3241c-65e6-4e47-83eb-08d9fc31bd47`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-82::DEBUG::2012-11-29 15:04:17,780::task::568::TaskManager.Task::(_updateState) Task=`31c3241c-65e6-4e47-83eb-08d9fc31bd47`::moving from state preparing -> state finished >Thread-82::DEBUG::2012-11-29 15:04:17,781::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-82::DEBUG::2012-11-29 15:04:17,781::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-82::DEBUG::2012-11-29 15:04:17,781::task::957::TaskManager.Task::(_decref) Task=`31c3241c-65e6-4e47-83eb-08d9fc31bd47`::ref 0 aborting False >Thread-84::DEBUG::2012-11-29 15:04:18,811::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-84::DEBUG::2012-11-29 15:04:18,811::task::568::TaskManager.Task::(_updateState) Task=`6c2d86a5-ccb4-477c-a52a-0c4852735a6f`::moving from state init -> state preparing >Thread-84::INFO::2012-11-29 15:04:18,812::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-84::DEBUG::2012-11-29 15:04:18,812::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-84::DEBUG::2012-11-29 15:04:18,812::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-84::INFO::2012-11-29 15:04:18,812::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-84::DEBUG::2012-11-29 15:04:18,812::task::1151::TaskManager.Task::(prepare) Task=`6c2d86a5-ccb4-477c-a52a-0c4852735a6f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-84::DEBUG::2012-11-29 15:04:18,812::task::568::TaskManager.Task::(_updateState) Task=`6c2d86a5-ccb4-477c-a52a-0c4852735a6f`::moving from state preparing -> state finished >Thread-84::DEBUG::2012-11-29 15:04:18,813::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84::DEBUG::2012-11-29 15:04:18,813::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84::DEBUG::2012-11-29 15:04:18,813::task::957::TaskManager.Task::(_decref) Task=`6c2d86a5-ccb4-477c-a52a-0c4852735a6f`::ref 0 aborting False >Thread-85::DEBUG::2012-11-29 15:04:19,843::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-85::DEBUG::2012-11-29 15:04:19,843::task::568::TaskManager.Task::(_updateState) Task=`11be72fe-916d-4b21-9d60-f2d67d7531c8`::moving from state init -> state preparing >Thread-85::INFO::2012-11-29 15:04:19,843::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-85::DEBUG::2012-11-29 15:04:19,843::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-85::DEBUG::2012-11-29 15:04:19,843::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-85::INFO::2012-11-29 15:04:19,843::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-85::DEBUG::2012-11-29 15:04:19,844::task::1151::TaskManager.Task::(prepare) Task=`11be72fe-916d-4b21-9d60-f2d67d7531c8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-85::DEBUG::2012-11-29 15:04:19,844::task::568::TaskManager.Task::(_updateState) Task=`11be72fe-916d-4b21-9d60-f2d67d7531c8`::moving from state preparing -> state finished >Thread-85::DEBUG::2012-11-29 15:04:19,844::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-85::DEBUG::2012-11-29 15:04:19,844::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-85::DEBUG::2012-11-29 15:04:19,844::task::957::TaskManager.Task::(_decref) Task=`11be72fe-916d-4b21-9d60-f2d67d7531c8`::ref 0 aborting False >Thread-87::DEBUG::2012-11-29 15:04:20,873::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-87::DEBUG::2012-11-29 15:04:20,873::task::568::TaskManager.Task::(_updateState) Task=`4291eb05-a9e5-44d6-96ab-0092c0879357`::moving from state init -> state preparing >Thread-87::INFO::2012-11-29 15:04:20,874::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-87::DEBUG::2012-11-29 15:04:20,874::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-87::DEBUG::2012-11-29 15:04:20,874::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-87::INFO::2012-11-29 15:04:20,874::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-87::DEBUG::2012-11-29 15:04:20,874::task::1151::TaskManager.Task::(prepare) Task=`4291eb05-a9e5-44d6-96ab-0092c0879357`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-87::DEBUG::2012-11-29 15:04:20,874::task::568::TaskManager.Task::(_updateState) Task=`4291eb05-a9e5-44d6-96ab-0092c0879357`::moving from state preparing -> state finished >Thread-87::DEBUG::2012-11-29 15:04:20,875::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-87::DEBUG::2012-11-29 15:04:20,875::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-87::DEBUG::2012-11-29 15:04:20,875::task::957::TaskManager.Task::(_decref) Task=`4291eb05-a9e5-44d6-96ab-0092c0879357`::ref 0 aborting False >Thread-88::DEBUG::2012-11-29 15:04:21,904::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-88::DEBUG::2012-11-29 15:04:21,904::task::568::TaskManager.Task::(_updateState) Task=`817d3309-fe90-4160-8556-9334702f15e7`::moving from state init -> state preparing >Thread-88::INFO::2012-11-29 15:04:21,904::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-88::DEBUG::2012-11-29 15:04:21,904::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-88::DEBUG::2012-11-29 15:04:21,905::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-88::INFO::2012-11-29 15:04:21,905::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-88::DEBUG::2012-11-29 15:04:21,905::task::1151::TaskManager.Task::(prepare) Task=`817d3309-fe90-4160-8556-9334702f15e7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-88::DEBUG::2012-11-29 15:04:21,905::task::568::TaskManager.Task::(_updateState) Task=`817d3309-fe90-4160-8556-9334702f15e7`::moving from state preparing -> state finished >Thread-88::DEBUG::2012-11-29 15:04:21,905::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-88::DEBUG::2012-11-29 15:04:21,905::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-88::DEBUG::2012-11-29 15:04:21,906::task::957::TaskManager.Task::(_decref) Task=`817d3309-fe90-4160-8556-9334702f15e7`::ref 0 aborting False >Thread-90::DEBUG::2012-11-29 15:04:22,934::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-90::DEBUG::2012-11-29 15:04:22,934::task::568::TaskManager.Task::(_updateState) Task=`1d83d880-b3c1-47d9-a923-de0895950cf0`::moving from state init -> state preparing >Thread-90::INFO::2012-11-29 15:04:22,934::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-90::DEBUG::2012-11-29 15:04:22,934::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-90::DEBUG::2012-11-29 15:04:22,935::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-90::INFO::2012-11-29 15:04:22,935::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-90::DEBUG::2012-11-29 15:04:22,935::task::1151::TaskManager.Task::(prepare) Task=`1d83d880-b3c1-47d9-a923-de0895950cf0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-90::DEBUG::2012-11-29 15:04:22,935::task::568::TaskManager.Task::(_updateState) Task=`1d83d880-b3c1-47d9-a923-de0895950cf0`::moving from state preparing -> state finished >Thread-90::DEBUG::2012-11-29 15:04:22,935::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-90::DEBUG::2012-11-29 15:04:22,935::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-90::DEBUG::2012-11-29 15:04:22,935::task::957::TaskManager.Task::(_decref) Task=`1d83d880-b3c1-47d9-a923-de0895950cf0`::ref 0 aborting False >Thread-91::DEBUG::2012-11-29 15:04:23,965::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-91::DEBUG::2012-11-29 15:04:23,965::task::568::TaskManager.Task::(_updateState) Task=`c7de0185-7d0d-4634-98c0-087eb107a43a`::moving from state init -> state preparing >Thread-91::INFO::2012-11-29 15:04:23,965::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-91::DEBUG::2012-11-29 15:04:23,965::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-91::DEBUG::2012-11-29 15:04:23,965::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-91::INFO::2012-11-29 15:04:23,966::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-91::DEBUG::2012-11-29 15:04:23,966::task::1151::TaskManager.Task::(prepare) Task=`c7de0185-7d0d-4634-98c0-087eb107a43a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-91::DEBUG::2012-11-29 15:04:23,966::task::568::TaskManager.Task::(_updateState) Task=`c7de0185-7d0d-4634-98c0-087eb107a43a`::moving from state preparing -> state finished >Thread-91::DEBUG::2012-11-29 15:04:23,966::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-91::DEBUG::2012-11-29 15:04:23,966::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2012-11-29 15:04:23,966::task::957::TaskManager.Task::(_decref) Task=`c7de0185-7d0d-4634-98c0-087eb107a43a`::ref 0 aborting False >Thread-93::DEBUG::2012-11-29 15:04:24,998::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-93::DEBUG::2012-11-29 15:04:24,998::task::568::TaskManager.Task::(_updateState) Task=`d35bf4de-baee-4557-b91f-af413461ecd3`::moving from state init -> state preparing >Thread-93::INFO::2012-11-29 15:04:24,998::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-93::DEBUG::2012-11-29 15:04:24,998::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-93::DEBUG::2012-11-29 15:04:24,998::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-93::INFO::2012-11-29 15:04:24,999::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-93::DEBUG::2012-11-29 15:04:24,999::task::1151::TaskManager.Task::(prepare) Task=`d35bf4de-baee-4557-b91f-af413461ecd3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-93::DEBUG::2012-11-29 15:04:24,999::task::568::TaskManager.Task::(_updateState) Task=`d35bf4de-baee-4557-b91f-af413461ecd3`::moving from state preparing -> state finished >Thread-93::DEBUG::2012-11-29 15:04:24,999::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-93::DEBUG::2012-11-29 15:04:24,999::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-93::DEBUG::2012-11-29 15:04:24,999::task::957::TaskManager.Task::(_decref) Task=`d35bf4de-baee-4557-b91f-af413461ecd3`::ref 0 aborting False >Thread-94::DEBUG::2012-11-29 15:04:26,029::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-94::DEBUG::2012-11-29 15:04:26,029::task::568::TaskManager.Task::(_updateState) Task=`177b2a20-2eeb-48a2-b574-54d429979052`::moving from state init -> state preparing >Thread-94::INFO::2012-11-29 15:04:26,030::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-94::DEBUG::2012-11-29 15:04:26,030::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-94::DEBUG::2012-11-29 15:04:26,030::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-94::INFO::2012-11-29 15:04:26,030::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-94::DEBUG::2012-11-29 15:04:26,030::task::1151::TaskManager.Task::(prepare) Task=`177b2a20-2eeb-48a2-b574-54d429979052`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-94::DEBUG::2012-11-29 15:04:26,030::task::568::TaskManager.Task::(_updateState) Task=`177b2a20-2eeb-48a2-b574-54d429979052`::moving from state preparing -> state finished >Thread-94::DEBUG::2012-11-29 15:04:26,030::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-94::DEBUG::2012-11-29 15:04:26,031::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-94::DEBUG::2012-11-29 15:04:26,031::task::957::TaskManager.Task::(_decref) Task=`177b2a20-2eeb-48a2-b574-54d429979052`::ref 0 aborting False >Thread-95::DEBUG::2012-11-29 15:04:26,675::task::568::TaskManager.Task::(_updateState) Task=`536e0cbf-3d66-468b-afd3-0cdd2b74a630`::moving from state init -> state preparing >Thread-95::INFO::2012-11-29 15:04:26,675::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-95::INFO::2012-11-29 15:04:26,675::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00101900100708', 'lastCheck': '7.4', 'code': 0, 'valid': True}} >Thread-95::DEBUG::2012-11-29 15:04:26,675::task::1151::TaskManager.Task::(prepare) Task=`536e0cbf-3d66-468b-afd3-0cdd2b74a630`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00101900100708', 'lastCheck': '7.4', 'code': 0, 'valid': True}} >Thread-95::DEBUG::2012-11-29 15:04:26,676::task::568::TaskManager.Task::(_updateState) Task=`536e0cbf-3d66-468b-afd3-0cdd2b74a630`::moving from state preparing -> state finished >Thread-95::DEBUG::2012-11-29 15:04:26,676::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-95::DEBUG::2012-11-29 15:04:26,676::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-95::DEBUG::2012-11-29 15:04:26,676::task::957::TaskManager.Task::(_decref) Task=`536e0cbf-3d66-468b-afd3-0cdd2b74a630`::ref 0 aborting False >Thread-97::DEBUG::2012-11-29 15:04:27,067::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-97::DEBUG::2012-11-29 15:04:27,068::task::568::TaskManager.Task::(_updateState) Task=`41394916-ea23-4279-a7df-fc5498c625bb`::moving from state init -> state preparing >Thread-97::INFO::2012-11-29 15:04:27,068::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-97::DEBUG::2012-11-29 15:04:27,068::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-97::DEBUG::2012-11-29 15:04:27,068::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-97::INFO::2012-11-29 15:04:27,068::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-97::DEBUG::2012-11-29 15:04:27,068::task::1151::TaskManager.Task::(prepare) Task=`41394916-ea23-4279-a7df-fc5498c625bb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-97::DEBUG::2012-11-29 15:04:27,069::task::568::TaskManager.Task::(_updateState) Task=`41394916-ea23-4279-a7df-fc5498c625bb`::moving from state preparing -> state finished >Thread-97::DEBUG::2012-11-29 15:04:27,069::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2012-11-29 15:04:27,069::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2012-11-29 15:04:27,069::task::957::TaskManager.Task::(_decref) Task=`41394916-ea23-4279-a7df-fc5498c625bb`::ref 0 aborting False >Thread-98::DEBUG::2012-11-29 15:04:28,098::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-98::DEBUG::2012-11-29 15:04:28,099::task::568::TaskManager.Task::(_updateState) Task=`125ec5b4-6dfc-4ebb-8bca-820c3d774157`::moving from state init -> state preparing >Thread-98::INFO::2012-11-29 15:04:28,099::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-98::DEBUG::2012-11-29 15:04:28,099::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-98::DEBUG::2012-11-29 15:04:28,099::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-98::INFO::2012-11-29 15:04:28,099::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-98::DEBUG::2012-11-29 15:04:28,099::task::1151::TaskManager.Task::(prepare) Task=`125ec5b4-6dfc-4ebb-8bca-820c3d774157`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-98::DEBUG::2012-11-29 15:04:28,100::task::568::TaskManager.Task::(_updateState) Task=`125ec5b4-6dfc-4ebb-8bca-820c3d774157`::moving from state preparing -> state finished >Thread-98::DEBUG::2012-11-29 15:04:28,100::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-98::DEBUG::2012-11-29 15:04:28,100::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-98::DEBUG::2012-11-29 15:04:28,100::task::957::TaskManager.Task::(_decref) Task=`125ec5b4-6dfc-4ebb-8bca-820c3d774157`::ref 0 aborting False >Thread-100::DEBUG::2012-11-29 15:04:29,130::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-100::DEBUG::2012-11-29 15:04:29,130::task::568::TaskManager.Task::(_updateState) Task=`6c5a442c-4f10-474e-9340-2f8b35d829c1`::moving from state init -> state preparing >Thread-100::INFO::2012-11-29 15:04:29,130::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-100::DEBUG::2012-11-29 15:04:29,130::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-100::DEBUG::2012-11-29 15:04:29,130::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-100::INFO::2012-11-29 15:04:29,130::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-100::DEBUG::2012-11-29 15:04:29,131::task::1151::TaskManager.Task::(prepare) Task=`6c5a442c-4f10-474e-9340-2f8b35d829c1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-100::DEBUG::2012-11-29 15:04:29,131::task::568::TaskManager.Task::(_updateState) Task=`6c5a442c-4f10-474e-9340-2f8b35d829c1`::moving from state preparing -> state finished >Thread-100::DEBUG::2012-11-29 15:04:29,131::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-100::DEBUG::2012-11-29 15:04:29,131::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-100::DEBUG::2012-11-29 15:04:29,131::task::957::TaskManager.Task::(_decref) Task=`6c5a442c-4f10-474e-9340-2f8b35d829c1`::ref 0 aborting False >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,544::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,544::safelease::109::ClusterLock::(acquire) Clustered lock acquired successfully >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,544::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,546::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=fdf826fc02fcbc6cdd7ad2eef0e215fe402af874'] >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,546::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,547::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,547::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=0', '_SHA_CKSUM=841f6640ffae61692b14b0cd4ca8a8864d80ec83'] >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,548::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,549::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`038569fd-4a8d-43cd-b7a5-bc3c21690f24`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,549::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,549::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,550::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`038569fd-4a8d-43cd-b7a5-bc3c21690f24`::Granted request >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::INFO::2012-11-29 15:04:29,550::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `4d25f33e-850f-4088-8f0b-e9cbc8276313` >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,551::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`0b536990-17bd-46d5-91a9-060fc56ffed6`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,551::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'exclusive' >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,551::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'exclusive' (1 active user) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,551::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`0b536990-17bd-46d5-91a9-060fc56ffed6`::Granted request >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,552::formatConverter::91::Storage.v3DomainConverter::(v3DomainConverter) Starting conversion for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,552::formatConverter::93::Storage.v3DomainConverter::(v3DomainConverter) Initializing the new cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:29,671::formatConverter::98::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the host id 1 for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::INFO::2012-11-29 15:04:29,671::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 (id: 1) >Thread-101::DEBUG::2012-11-29 15:04:30,160::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-101::DEBUG::2012-11-29 15:04:30,161::task::568::TaskManager.Task::(_updateState) Task=`d3536f81-891a-41c3-aea4-0930200f3151`::moving from state init -> state preparing >Thread-101::INFO::2012-11-29 15:04:30,161::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-101::DEBUG::2012-11-29 15:04:30,161::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-101::DEBUG::2012-11-29 15:04:30,161::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-101::INFO::2012-11-29 15:04:30,161::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-101::DEBUG::2012-11-29 15:04:30,162::task::1151::TaskManager.Task::(prepare) Task=`d3536f81-891a-41c3-aea4-0930200f3151`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-101::DEBUG::2012-11-29 15:04:30,162::task::568::TaskManager.Task::(_updateState) Task=`d3536f81-891a-41c3-aea4-0930200f3151`::moving from state preparing -> state finished >Thread-101::DEBUG::2012-11-29 15:04:30,162::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-101::DEBUG::2012-11-29 15:04:30,162::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-101::DEBUG::2012-11-29 15:04:30,162::task::957::TaskManager.Task::(_decref) Task=`d3536f81-891a-41c3-aea4-0930200f3151`::ref 0 aborting False >Thread-103::DEBUG::2012-11-29 15:04:31,193::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-103::DEBUG::2012-11-29 15:04:31,193::task::568::TaskManager.Task::(_updateState) Task=`c67cd458-296f-4936-b565-57e4074de813`::moving from state init -> state preparing >Thread-103::INFO::2012-11-29 15:04:31,193::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-103::DEBUG::2012-11-29 15:04:31,193::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-103::DEBUG::2012-11-29 15:04:31,193::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-103::INFO::2012-11-29 15:04:31,194::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-103::DEBUG::2012-11-29 15:04:31,194::task::1151::TaskManager.Task::(prepare) Task=`c67cd458-296f-4936-b565-57e4074de813`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-103::DEBUG::2012-11-29 15:04:31,194::task::568::TaskManager.Task::(_updateState) Task=`c67cd458-296f-4936-b565-57e4074de813`::moving from state preparing -> state finished >Thread-103::DEBUG::2012-11-29 15:04:31,194::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-103::DEBUG::2012-11-29 15:04:31,194::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-103::DEBUG::2012-11-29 15:04:31,194::task::957::TaskManager.Task::(_decref) Task=`c67cd458-296f-4936-b565-57e4074de813`::ref 0 aborting False >Thread-104::DEBUG::2012-11-29 15:04:32,224::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-104::DEBUG::2012-11-29 15:04:32,224::task::568::TaskManager.Task::(_updateState) Task=`9bec323c-d5ee-4c0e-a0dd-7e6ebfaa6eea`::moving from state init -> state preparing >Thread-104::INFO::2012-11-29 15:04:32,225::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-104::DEBUG::2012-11-29 15:04:32,225::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-104::DEBUG::2012-11-29 15:04:32,225::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-104::INFO::2012-11-29 15:04:32,225::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-104::DEBUG::2012-11-29 15:04:32,225::task::1151::TaskManager.Task::(prepare) Task=`9bec323c-d5ee-4c0e-a0dd-7e6ebfaa6eea`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-104::DEBUG::2012-11-29 15:04:32,225::task::568::TaskManager.Task::(_updateState) Task=`9bec323c-d5ee-4c0e-a0dd-7e6ebfaa6eea`::moving from state preparing -> state finished >Thread-104::DEBUG::2012-11-29 15:04:32,226::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-104::DEBUG::2012-11-29 15:04:32,226::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-104::DEBUG::2012-11-29 15:04:32,226::task::957::TaskManager.Task::(_decref) Task=`9bec323c-d5ee-4c0e-a0dd-7e6ebfaa6eea`::ref 0 aborting False >Thread-106::DEBUG::2012-11-29 15:04:33,256::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-106::DEBUG::2012-11-29 15:04:33,256::task::568::TaskManager.Task::(_updateState) Task=`eab52795-1d2a-4740-8451-28fec0c3b165`::moving from state init -> state preparing >Thread-106::INFO::2012-11-29 15:04:33,256::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-106::DEBUG::2012-11-29 15:04:33,257::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-106::DEBUG::2012-11-29 15:04:33,257::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-106::INFO::2012-11-29 15:04:33,257::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-106::DEBUG::2012-11-29 15:04:33,257::task::1151::TaskManager.Task::(prepare) Task=`eab52795-1d2a-4740-8451-28fec0c3b165`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-106::DEBUG::2012-11-29 15:04:33,257::task::568::TaskManager.Task::(_updateState) Task=`eab52795-1d2a-4740-8451-28fec0c3b165`::moving from state preparing -> state finished >Thread-106::DEBUG::2012-11-29 15:04:33,257::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-106::DEBUG::2012-11-29 15:04:33,257::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-106::DEBUG::2012-11-29 15:04:33,258::task::957::TaskManager.Task::(_decref) Task=`eab52795-1d2a-4740-8451-28fec0c3b165`::ref 0 aborting False >Thread-107::DEBUG::2012-11-29 15:04:34,286::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-107::DEBUG::2012-11-29 15:04:34,287::task::568::TaskManager.Task::(_updateState) Task=`52b74543-3df5-4a96-ad2d-c33b8649674c`::moving from state init -> state preparing >Thread-107::INFO::2012-11-29 15:04:34,287::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-107::DEBUG::2012-11-29 15:04:34,287::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-107::DEBUG::2012-11-29 15:04:34,287::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-107::INFO::2012-11-29 15:04:34,287::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-107::DEBUG::2012-11-29 15:04:34,287::task::1151::TaskManager.Task::(prepare) Task=`52b74543-3df5-4a96-ad2d-c33b8649674c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-107::DEBUG::2012-11-29 15:04:34,288::task::568::TaskManager.Task::(_updateState) Task=`52b74543-3df5-4a96-ad2d-c33b8649674c`::moving from state preparing -> state finished >Thread-107::DEBUG::2012-11-29 15:04:34,288::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-107::DEBUG::2012-11-29 15:04:34,288::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-107::DEBUG::2012-11-29 15:04:34,288::task::957::TaskManager.Task::(_decref) Task=`52b74543-3df5-4a96-ad2d-c33b8649674c`::ref 0 aborting False >Thread-109::DEBUG::2012-11-29 15:04:35,425::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-109::DEBUG::2012-11-29 15:04:35,425::task::568::TaskManager.Task::(_updateState) Task=`094fc181-13b8-436a-93f3-d0857f568ed7`::moving from state init -> state preparing >Thread-109::INFO::2012-11-29 15:04:35,425::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-109::DEBUG::2012-11-29 15:04:35,426::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-109::DEBUG::2012-11-29 15:04:35,426::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-109::INFO::2012-11-29 15:04:35,426::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-109::DEBUG::2012-11-29 15:04:35,426::task::1151::TaskManager.Task::(prepare) Task=`094fc181-13b8-436a-93f3-d0857f568ed7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-109::DEBUG::2012-11-29 15:04:35,426::task::568::TaskManager.Task::(_updateState) Task=`094fc181-13b8-436a-93f3-d0857f568ed7`::moving from state preparing -> state finished >Thread-109::DEBUG::2012-11-29 15:04:35,426::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-109::DEBUG::2012-11-29 15:04:35,427::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-109::DEBUG::2012-11-29 15:04:35,427::task::957::TaskManager.Task::(_decref) Task=`094fc181-13b8-436a-93f3-d0857f568ed7`::ref 0 aborting False >Thread-110::DEBUG::2012-11-29 15:04:36,455::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-110::DEBUG::2012-11-29 15:04:36,456::task::568::TaskManager.Task::(_updateState) Task=`0865706d-4452-4de8-ab92-f928d16857e7`::moving from state init -> state preparing >Thread-110::INFO::2012-11-29 15:04:36,456::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-110::DEBUG::2012-11-29 15:04:36,456::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-110::DEBUG::2012-11-29 15:04:36,456::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-110::INFO::2012-11-29 15:04:36,456::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-110::DEBUG::2012-11-29 15:04:36,456::task::1151::TaskManager.Task::(prepare) Task=`0865706d-4452-4de8-ab92-f928d16857e7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-110::DEBUG::2012-11-29 15:04:36,457::task::568::TaskManager.Task::(_updateState) Task=`0865706d-4452-4de8-ab92-f928d16857e7`::moving from state preparing -> state finished >Thread-110::DEBUG::2012-11-29 15:04:36,457::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-110::DEBUG::2012-11-29 15:04:36,457::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-110::DEBUG::2012-11-29 15:04:36,457::task::957::TaskManager.Task::(_decref) Task=`0865706d-4452-4de8-ab92-f928d16857e7`::ref 0 aborting False >Thread-111::DEBUG::2012-11-29 15:04:36,891::task::568::TaskManager.Task::(_updateState) Task=`255c0376-aa66-4b81-8efe-77d44adac2c0`::moving from state init -> state preparing >Thread-111::INFO::2012-11-29 15:04:36,891::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-111::INFO::2012-11-29 15:04:36,892::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0010359287262', 'lastCheck': '7.6', 'code': 0, 'valid': True}} >Thread-111::DEBUG::2012-11-29 15:04:36,892::task::1151::TaskManager.Task::(prepare) Task=`255c0376-aa66-4b81-8efe-77d44adac2c0`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0010359287262', 'lastCheck': '7.6', 'code': 0, 'valid': True}} >Thread-111::DEBUG::2012-11-29 15:04:36,892::task::568::TaskManager.Task::(_updateState) Task=`255c0376-aa66-4b81-8efe-77d44adac2c0`::moving from state preparing -> state finished >Thread-111::DEBUG::2012-11-29 15:04:36,892::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-111::DEBUG::2012-11-29 15:04:36,892::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-111::DEBUG::2012-11-29 15:04:36,892::task::957::TaskManager.Task::(_decref) Task=`255c0376-aa66-4b81-8efe-77d44adac2c0`::ref 0 aborting False >Thread-113::DEBUG::2012-11-29 15:04:37,486::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-113::DEBUG::2012-11-29 15:04:37,486::task::568::TaskManager.Task::(_updateState) Task=`c1e92707-536f-4dcc-9812-1d83fb9063ac`::moving from state init -> state preparing >Thread-113::INFO::2012-11-29 15:04:37,486::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-113::DEBUG::2012-11-29 15:04:37,486::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-113::DEBUG::2012-11-29 15:04:37,487::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-113::INFO::2012-11-29 15:04:37,487::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-113::DEBUG::2012-11-29 15:04:37,487::task::1151::TaskManager.Task::(prepare) Task=`c1e92707-536f-4dcc-9812-1d83fb9063ac`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-113::DEBUG::2012-11-29 15:04:37,487::task::568::TaskManager.Task::(_updateState) Task=`c1e92707-536f-4dcc-9812-1d83fb9063ac`::moving from state preparing -> state finished >Thread-113::DEBUG::2012-11-29 15:04:37,487::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2012-11-29 15:04:37,487::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2012-11-29 15:04:37,487::task::957::TaskManager.Task::(_decref) Task=`c1e92707-536f-4dcc-9812-1d83fb9063ac`::ref 0 aborting False >Thread-114::DEBUG::2012-11-29 15:04:38,517::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-114::DEBUG::2012-11-29 15:04:38,518::task::568::TaskManager.Task::(_updateState) Task=`8a749d7e-42b0-4417-ba1d-78b6f7911d05`::moving from state init -> state preparing >Thread-114::INFO::2012-11-29 15:04:38,518::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-114::DEBUG::2012-11-29 15:04:38,518::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-114::DEBUG::2012-11-29 15:04:38,518::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-114::INFO::2012-11-29 15:04:38,518::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-114::DEBUG::2012-11-29 15:04:38,518::task::1151::TaskManager.Task::(prepare) Task=`8a749d7e-42b0-4417-ba1d-78b6f7911d05`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-114::DEBUG::2012-11-29 15:04:38,519::task::568::TaskManager.Task::(_updateState) Task=`8a749d7e-42b0-4417-ba1d-78b6f7911d05`::moving from state preparing -> state finished >Thread-114::DEBUG::2012-11-29 15:04:38,519::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-114::DEBUG::2012-11-29 15:04:38,519::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-114::DEBUG::2012-11-29 15:04:38,519::task::957::TaskManager.Task::(_decref) Task=`8a749d7e-42b0-4417-ba1d-78b6f7911d05`::ref 0 aborting False >Thread-116::DEBUG::2012-11-29 15:04:39,549::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-116::DEBUG::2012-11-29 15:04:39,549::task::568::TaskManager.Task::(_updateState) Task=`44d23c13-4061-4d86-b763-d25e62cdc899`::moving from state init -> state preparing >Thread-116::INFO::2012-11-29 15:04:39,549::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-116::DEBUG::2012-11-29 15:04:39,549::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-116::DEBUG::2012-11-29 15:04:39,549::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-116::INFO::2012-11-29 15:04:39,549::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-116::DEBUG::2012-11-29 15:04:39,550::task::1151::TaskManager.Task::(prepare) Task=`44d23c13-4061-4d86-b763-d25e62cdc899`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-116::DEBUG::2012-11-29 15:04:39,550::task::568::TaskManager.Task::(_updateState) Task=`44d23c13-4061-4d86-b763-d25e62cdc899`::moving from state preparing -> state finished >Thread-116::DEBUG::2012-11-29 15:04:39,550::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-116::DEBUG::2012-11-29 15:04:39,550::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-116::DEBUG::2012-11-29 15:04:39,550::task::957::TaskManager.Task::(_decref) Task=`44d23c13-4061-4d86-b763-d25e62cdc899`::ref 0 aborting False >Thread-117::DEBUG::2012-11-29 15:04:40,579::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-117::DEBUG::2012-11-29 15:04:40,579::task::568::TaskManager.Task::(_updateState) Task=`0ff52537-94c7-442e-b96f-8a13cf1942cb`::moving from state init -> state preparing >Thread-117::INFO::2012-11-29 15:04:40,580::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-117::DEBUG::2012-11-29 15:04:40,580::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-117::DEBUG::2012-11-29 15:04:40,580::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-117::INFO::2012-11-29 15:04:40,580::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-117::DEBUG::2012-11-29 15:04:40,580::task::1151::TaskManager.Task::(prepare) Task=`0ff52537-94c7-442e-b96f-8a13cf1942cb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-117::DEBUG::2012-11-29 15:04:40,580::task::568::TaskManager.Task::(_updateState) Task=`0ff52537-94c7-442e-b96f-8a13cf1942cb`::moving from state preparing -> state finished >Thread-117::DEBUG::2012-11-29 15:04:40,581::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-117::DEBUG::2012-11-29 15:04:40,581::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-117::DEBUG::2012-11-29 15:04:40,581::task::957::TaskManager.Task::(_decref) Task=`0ff52537-94c7-442e-b96f-8a13cf1942cb`::ref 0 aborting False >Thread-119::DEBUG::2012-11-29 15:04:41,613::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-119::DEBUG::2012-11-29 15:04:41,613::task::568::TaskManager.Task::(_updateState) Task=`3eedfe1c-57ca-4de1-8165-a527a2edfdfa`::moving from state init -> state preparing >Thread-119::INFO::2012-11-29 15:04:41,614::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-119::DEBUG::2012-11-29 15:04:41,614::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-119::DEBUG::2012-11-29 15:04:41,614::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-119::INFO::2012-11-29 15:04:41,614::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-119::DEBUG::2012-11-29 15:04:41,614::task::1151::TaskManager.Task::(prepare) Task=`3eedfe1c-57ca-4de1-8165-a527a2edfdfa`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-119::DEBUG::2012-11-29 15:04:41,614::task::568::TaskManager.Task::(_updateState) Task=`3eedfe1c-57ca-4de1-8165-a527a2edfdfa`::moving from state preparing -> state finished >Thread-119::DEBUG::2012-11-29 15:04:41,615::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-119::DEBUG::2012-11-29 15:04:41,615::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-119::DEBUG::2012-11-29 15:04:41,615::task::957::TaskManager.Task::(_decref) Task=`3eedfe1c-57ca-4de1-8165-a527a2edfdfa`::ref 0 aborting False >Thread-120::DEBUG::2012-11-29 15:04:42,644::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-120::DEBUG::2012-11-29 15:04:42,644::task::568::TaskManager.Task::(_updateState) Task=`9249c28c-824b-451c-b15f-e0f23160ffbe`::moving from state init -> state preparing >Thread-120::INFO::2012-11-29 15:04:42,644::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-120::DEBUG::2012-11-29 15:04:42,644::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-120::DEBUG::2012-11-29 15:04:42,644::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-120::INFO::2012-11-29 15:04:42,645::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-120::DEBUG::2012-11-29 15:04:42,645::task::1151::TaskManager.Task::(prepare) Task=`9249c28c-824b-451c-b15f-e0f23160ffbe`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-120::DEBUG::2012-11-29 15:04:42,645::task::568::TaskManager.Task::(_updateState) Task=`9249c28c-824b-451c-b15f-e0f23160ffbe`::moving from state preparing -> state finished >Thread-120::DEBUG::2012-11-29 15:04:42,645::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-120::DEBUG::2012-11-29 15:04:42,645::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-120::DEBUG::2012-11-29 15:04:42,645::task::957::TaskManager.Task::(_decref) Task=`9249c28c-824b-451c-b15f-e0f23160ffbe`::ref 0 aborting False >Thread-122::DEBUG::2012-11-29 15:04:43,675::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-122::DEBUG::2012-11-29 15:04:43,675::task::568::TaskManager.Task::(_updateState) Task=`8873c356-c616-4f7a-8907-9ea4a7f997b0`::moving from state init -> state preparing >Thread-122::INFO::2012-11-29 15:04:43,675::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-122::DEBUG::2012-11-29 15:04:43,675::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-122::DEBUG::2012-11-29 15:04:43,675::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-122::INFO::2012-11-29 15:04:43,676::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-122::DEBUG::2012-11-29 15:04:43,676::task::1151::TaskManager.Task::(prepare) Task=`8873c356-c616-4f7a-8907-9ea4a7f997b0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-122::DEBUG::2012-11-29 15:04:43,676::task::568::TaskManager.Task::(_updateState) Task=`8873c356-c616-4f7a-8907-9ea4a7f997b0`::moving from state preparing -> state finished >Thread-122::DEBUG::2012-11-29 15:04:43,676::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-122::DEBUG::2012-11-29 15:04:43,676::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-122::DEBUG::2012-11-29 15:04:43,676::task::957::TaskManager.Task::(_decref) Task=`8873c356-c616-4f7a-8907-9ea4a7f997b0`::ref 0 aborting False >Thread-123::DEBUG::2012-11-29 15:04:44,707::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-123::DEBUG::2012-11-29 15:04:44,707::task::568::TaskManager.Task::(_updateState) Task=`a724d386-90d9-4aeb-895b-12b2628320e7`::moving from state init -> state preparing >Thread-123::INFO::2012-11-29 15:04:44,707::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-123::DEBUG::2012-11-29 15:04:44,707::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-123::DEBUG::2012-11-29 15:04:44,707::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-123::INFO::2012-11-29 15:04:44,708::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-123::DEBUG::2012-11-29 15:04:44,708::task::1151::TaskManager.Task::(prepare) Task=`a724d386-90d9-4aeb-895b-12b2628320e7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-123::DEBUG::2012-11-29 15:04:44,708::task::568::TaskManager.Task::(_updateState) Task=`a724d386-90d9-4aeb-895b-12b2628320e7`::moving from state preparing -> state finished >Thread-123::DEBUG::2012-11-29 15:04:44,708::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-123::DEBUG::2012-11-29 15:04:44,708::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-123::DEBUG::2012-11-29 15:04:44,708::task::957::TaskManager.Task::(_decref) Task=`a724d386-90d9-4aeb-895b-12b2628320e7`::ref 0 aborting False >Thread-125::DEBUG::2012-11-29 15:04:45,737::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-125::DEBUG::2012-11-29 15:04:45,737::task::568::TaskManager.Task::(_updateState) Task=`e0105157-67ff-479a-bce1-db76ddd1af80`::moving from state init -> state preparing >Thread-125::INFO::2012-11-29 15:04:45,738::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-125::DEBUG::2012-11-29 15:04:45,738::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-125::DEBUG::2012-11-29 15:04:45,738::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-125::INFO::2012-11-29 15:04:45,738::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-125::DEBUG::2012-11-29 15:04:45,738::task::1151::TaskManager.Task::(prepare) Task=`e0105157-67ff-479a-bce1-db76ddd1af80`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-125::DEBUG::2012-11-29 15:04:45,738::task::568::TaskManager.Task::(_updateState) Task=`e0105157-67ff-479a-bce1-db76ddd1af80`::moving from state preparing -> state finished >Thread-125::DEBUG::2012-11-29 15:04:45,739::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-125::DEBUG::2012-11-29 15:04:45,739::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-125::DEBUG::2012-11-29 15:04:45,739::task::957::TaskManager.Task::(_decref) Task=`e0105157-67ff-479a-bce1-db76ddd1af80`::ref 0 aborting False >Thread-126::DEBUG::2012-11-29 15:04:46,767::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-126::DEBUG::2012-11-29 15:04:46,768::task::568::TaskManager.Task::(_updateState) Task=`8c1f9031-b73a-4138-bfc6-f2e4c9103cd7`::moving from state init -> state preparing >Thread-126::INFO::2012-11-29 15:04:46,768::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-126::DEBUG::2012-11-29 15:04:46,768::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-126::DEBUG::2012-11-29 15:04:46,768::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-126::INFO::2012-11-29 15:04:46,768::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-126::DEBUG::2012-11-29 15:04:46,768::task::1151::TaskManager.Task::(prepare) Task=`8c1f9031-b73a-4138-bfc6-f2e4c9103cd7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-126::DEBUG::2012-11-29 15:04:46,769::task::568::TaskManager.Task::(_updateState) Task=`8c1f9031-b73a-4138-bfc6-f2e4c9103cd7`::moving from state preparing -> state finished >Thread-126::DEBUG::2012-11-29 15:04:46,769::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-126::DEBUG::2012-11-29 15:04:46,769::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-126::DEBUG::2012-11-29 15:04:46,769::task::957::TaskManager.Task::(_decref) Task=`8c1f9031-b73a-4138-bfc6-f2e4c9103cd7`::ref 0 aborting False >Thread-127::DEBUG::2012-11-29 15:04:47,100::task::568::TaskManager.Task::(_updateState) Task=`b326566a-ddf5-40d2-9251-b8d8724502da`::moving from state init -> state preparing >Thread-127::INFO::2012-11-29 15:04:47,101::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-127::INFO::2012-11-29 15:04:47,101::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00109100341797', 'lastCheck': '7.8', 'code': 0, 'valid': True}} >Thread-127::DEBUG::2012-11-29 15:04:47,101::task::1151::TaskManager.Task::(prepare) Task=`b326566a-ddf5-40d2-9251-b8d8724502da`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00109100341797', 'lastCheck': '7.8', 'code': 0, 'valid': True}} >Thread-127::DEBUG::2012-11-29 15:04:47,101::task::568::TaskManager.Task::(_updateState) Task=`b326566a-ddf5-40d2-9251-b8d8724502da`::moving from state preparing -> state finished >Thread-127::DEBUG::2012-11-29 15:04:47,101::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-127::DEBUG::2012-11-29 15:04:47,101::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-127::DEBUG::2012-11-29 15:04:47,102::task::957::TaskManager.Task::(_decref) Task=`b326566a-ddf5-40d2-9251-b8d8724502da`::ref 0 aborting False >Thread-129::DEBUG::2012-11-29 15:04:47,800::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-129::DEBUG::2012-11-29 15:04:47,800::task::568::TaskManager.Task::(_updateState) Task=`67d8fd19-dd53-43c6-8a39-c4f266260da8`::moving from state init -> state preparing >Thread-129::INFO::2012-11-29 15:04:47,800::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-129::DEBUG::2012-11-29 15:04:47,800::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-129::DEBUG::2012-11-29 15:04:47,800::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-129::INFO::2012-11-29 15:04:47,801::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-129::DEBUG::2012-11-29 15:04:47,801::task::1151::TaskManager.Task::(prepare) Task=`67d8fd19-dd53-43c6-8a39-c4f266260da8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-129::DEBUG::2012-11-29 15:04:47,801::task::568::TaskManager.Task::(_updateState) Task=`67d8fd19-dd53-43c6-8a39-c4f266260da8`::moving from state preparing -> state finished >Thread-129::DEBUG::2012-11-29 15:04:47,801::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-129::DEBUG::2012-11-29 15:04:47,801::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-129::DEBUG::2012-11-29 15:04:47,801::task::957::TaskManager.Task::(_decref) Task=`67d8fd19-dd53-43c6-8a39-c4f266260da8`::ref 0 aborting False >Thread-130::DEBUG::2012-11-29 15:04:48,846::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-130::DEBUG::2012-11-29 15:04:48,846::task::568::TaskManager.Task::(_updateState) Task=`c2b750c3-59f4-42da-8d8d-4a626897529a`::moving from state init -> state preparing >Thread-130::INFO::2012-11-29 15:04:48,846::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-130::DEBUG::2012-11-29 15:04:48,847::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-130::DEBUG::2012-11-29 15:04:48,847::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-130::INFO::2012-11-29 15:04:48,847::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-130::DEBUG::2012-11-29 15:04:48,847::task::1151::TaskManager.Task::(prepare) Task=`c2b750c3-59f4-42da-8d8d-4a626897529a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-130::DEBUG::2012-11-29 15:04:48,847::task::568::TaskManager.Task::(_updateState) Task=`c2b750c3-59f4-42da-8d8d-4a626897529a`::moving from state preparing -> state finished >Thread-130::DEBUG::2012-11-29 15:04:48,847::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-130::DEBUG::2012-11-29 15:04:48,848::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-130::DEBUG::2012-11-29 15:04:48,848::task::957::TaskManager.Task::(_decref) Task=`c2b750c3-59f4-42da-8d8d-4a626897529a`::ref 0 aborting False >Thread-132::DEBUG::2012-11-29 15:04:49,876::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-132::DEBUG::2012-11-29 15:04:49,877::task::568::TaskManager.Task::(_updateState) Task=`9b349620-b0a5-4cb3-9a7d-20dcab7d68a1`::moving from state init -> state preparing >Thread-132::INFO::2012-11-29 15:04:49,877::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-132::DEBUG::2012-11-29 15:04:49,877::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-132::DEBUG::2012-11-29 15:04:49,877::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-132::INFO::2012-11-29 15:04:49,877::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-132::DEBUG::2012-11-29 15:04:49,877::task::1151::TaskManager.Task::(prepare) Task=`9b349620-b0a5-4cb3-9a7d-20dcab7d68a1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-132::DEBUG::2012-11-29 15:04:49,878::task::568::TaskManager.Task::(_updateState) Task=`9b349620-b0a5-4cb3-9a7d-20dcab7d68a1`::moving from state preparing -> state finished >Thread-132::DEBUG::2012-11-29 15:04:49,878::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-132::DEBUG::2012-11-29 15:04:49,878::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-132::DEBUG::2012-11-29 15:04:49,878::task::957::TaskManager.Task::(_decref) Task=`9b349620-b0a5-4cb3-9a7d-20dcab7d68a1`::ref 0 aborting False >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,676::safelease::178::SANLock::(acquireHostId) Host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 successfully acquired (id: 1) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,678::formatConverter::136::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 with host id: 1 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::INFO::2012-11-29 15:04:50,678::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 (id: 1) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,763::safelease::235::SANLock::(acquire) Cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 successfully acquired (id: 1) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,771::formatConverter::214::Storage.v3DomainConverter::(v3DomainConverter) Finalizing the storage domain upgrade from version 0 to version 3 for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,771::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,771::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,772::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=e459136b318686b029466b3ded781bd95ae1ee44'] >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,773::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::INFO::2012-11-29 15:04:50,773::safelease::119::ClusterLock::(release) Releasing cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:50,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 4d25f33e-850f-4088-8f0b-e9cbc8276313' (cwd /usr/libexec/vdsm) >Thread-133::DEBUG::2012-11-29 15:04:50,907::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-133::DEBUG::2012-11-29 15:04:50,908::task::568::TaskManager.Task::(_updateState) Task=`fdb33380-26e5-453e-abe2-3fbbfa68f76b`::moving from state init -> state preparing >Thread-133::INFO::2012-11-29 15:04:50,908::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-133::DEBUG::2012-11-29 15:04:50,908::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-133::DEBUG::2012-11-29 15:04:50,908::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-133::INFO::2012-11-29 15:04:50,908::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-133::DEBUG::2012-11-29 15:04:50,909::task::1151::TaskManager.Task::(prepare) Task=`fdb33380-26e5-453e-abe2-3fbbfa68f76b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-133::DEBUG::2012-11-29 15:04:50,909::task::568::TaskManager.Task::(_updateState) Task=`fdb33380-26e5-453e-abe2-3fbbfa68f76b`::moving from state preparing -> state finished >Thread-133::DEBUG::2012-11-29 15:04:50,909::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-133::DEBUG::2012-11-29 15:04:50,909::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-133::DEBUG::2012-11-29 15:04:50,909::task::957::TaskManager.Task::(_decref) Task=`fdb33380-26e5-453e-abe2-3fbbfa68f76b`::ref 0 aborting False >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,801::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,801::safelease::126::ClusterLock::(release) Cluster lock released successfully >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,802::formatConverter::257::Storage.v3DomainConverter::(v3DomainConverter) Switching the cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,802::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,803::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4d25f33e-850f-4088-8f0b-e9cbc8276313' (cwd None) >Thread-135::DEBUG::2012-11-29 15:04:51,940::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-135::DEBUG::2012-11-29 15:04:51,940::task::568::TaskManager.Task::(_updateState) Task=`c43fafee-a965-4871-ab91-915b10de2603`::moving from state init -> state preparing >Thread-135::INFO::2012-11-29 15:04:51,941::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-135::DEBUG::2012-11-29 15:04:51,941::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-135::DEBUG::2012-11-29 15:04:51,941::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-135::INFO::2012-11-29 15:04:51,942::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-135::DEBUG::2012-11-29 15:04:51,942::task::1151::TaskManager.Task::(prepare) Task=`c43fafee-a965-4871-ab91-915b10de2603`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-135::DEBUG::2012-11-29 15:04:51,942::task::568::TaskManager.Task::(_updateState) Task=`c43fafee-a965-4871-ab91-915b10de2603`::moving from state preparing -> state finished >Thread-135::DEBUG::2012-11-29 15:04:51,943::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135::DEBUG::2012-11-29 15:04:51,943::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135::DEBUG::2012-11-29 15:04:51,943::task::957::TaskManager.Task::(_decref) Task=`c43fafee-a965-4871-ab91-915b10de2603`::ref 0 aborting False >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,964::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found\n'; <rc> = 5 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::WARNING::2012-11-29 15:04:51,964::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found'] >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,965::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,966::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,967::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,968::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=e459136b318686b029466b3ded781bd95ae1ee44'] >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,970::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::WARNING::2012-11-29 15:04:51,970::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS already registered >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::WARNING::2012-11-29 15:04:51,970::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_volumeNS already registered >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,970::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,971::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,971::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,971::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,971::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,971::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,972::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,972::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,972::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,972::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,972::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::WARNING::2012-11-29 15:04:51,973::sd::590::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313/master/vms) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::WARNING::2012-11-29 15:04:51,974::sd::595::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313/master/tasks) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,974::sp::309::Storage.StoragePool::(startSpm) ended. >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,974::task::568::TaskManager.Task::(_updateState) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::moving from state running -> state finished >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,975::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,975::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,975::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,975::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,975::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,976::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,976::task::880::TaskManager.Task::(_runJobs) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::Task.run: exit - success: result >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,976::task::957::TaskManager.Task::(_decref) Task=`4fb52d6f-7a14-4a22-b214-d55e07bcf7ad`::ref 0 aborting False >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:04:51,976::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-137::DEBUG::2012-11-29 15:04:52,973::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-137::DEBUG::2012-11-29 15:04:52,973::task::568::TaskManager.Task::(_updateState) Task=`51c9ce23-6c7a-4bf5-a227-a180614af5cd`::moving from state init -> state preparing >Thread-137::INFO::2012-11-29 15:04:52,974::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-137::DEBUG::2012-11-29 15:04:52,974::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-137::DEBUG::2012-11-29 15:04:52,974::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'} >Thread-137::INFO::2012-11-29 15:04:52,974::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-137::DEBUG::2012-11-29 15:04:52,974::task::1151::TaskManager.Task::(prepare) Task=`51c9ce23-6c7a-4bf5-a227-a180614af5cd`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4fb52d6f-7a14-4a22-b214-d55e07bcf7ad'}} >Thread-137::DEBUG::2012-11-29 15:04:52,974::task::568::TaskManager.Task::(_updateState) Task=`51c9ce23-6c7a-4bf5-a227-a180614af5cd`::moving from state preparing -> state finished >Thread-137::DEBUG::2012-11-29 15:04:52,975::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137::DEBUG::2012-11-29 15:04:52,975::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137::DEBUG::2012-11-29 15:04:52,975::task::957::TaskManager.Task::(_decref) Task=`51c9ce23-6c7a-4bf5-a227-a180614af5cd`::ref 0 aborting False >Thread-138::DEBUG::2012-11-29 15:04:53,001::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-138::DEBUG::2012-11-29 15:04:53,002::task::568::TaskManager.Task::(_updateState) Task=`ffe9facd-ba97-4093-af4a-c0a529defe65`::moving from state init -> state preparing >Thread-138::INFO::2012-11-29 15:04:53,002::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-138::INFO::2012-11-29 15:04:53,002::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-138::DEBUG::2012-11-29 15:04:53,002::task::1151::TaskManager.Task::(prepare) Task=`ffe9facd-ba97-4093-af4a-c0a529defe65`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-138::DEBUG::2012-11-29 15:04:53,003::task::568::TaskManager.Task::(_updateState) Task=`ffe9facd-ba97-4093-af4a-c0a529defe65`::moving from state preparing -> state finished >Thread-138::DEBUG::2012-11-29 15:04:53,003::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-138::DEBUG::2012-11-29 15:04:53,003::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138::DEBUG::2012-11-29 15:04:53,003::task::957::TaskManager.Task::(_decref) Task=`ffe9facd-ba97-4093-af4a-c0a529defe65`::ref 0 aborting False >Thread-139::DEBUG::2012-11-29 15:04:53,038::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-139::DEBUG::2012-11-29 15:04:53,038::task::568::TaskManager.Task::(_updateState) Task=`e1c26fa4-47e7-458a-94fd-555a676b87e5`::moving from state init -> state preparing >Thread-139::INFO::2012-11-29 15:04:53,038::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='4fb52d6f-7a14-4a22-b214-d55e07bcf7ad', spUUID=None, options=None) >Thread-139::DEBUG::2012-11-29 15:04:53,038::taskManager::161::TaskManager::(clearTask) Entry. taskID: 4fb52d6f-7a14-4a22-b214-d55e07bcf7ad >Thread-139::DEBUG::2012-11-29 15:04:53,039::taskManager::166::TaskManager::(clearTask) Return. >Thread-139::INFO::2012-11-29 15:04:53,039::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-139::DEBUG::2012-11-29 15:04:53,039::task::1151::TaskManager.Task::(prepare) Task=`e1c26fa4-47e7-458a-94fd-555a676b87e5`::finished: None >Thread-139::DEBUG::2012-11-29 15:04:53,039::task::568::TaskManager.Task::(_updateState) Task=`e1c26fa4-47e7-458a-94fd-555a676b87e5`::moving from state preparing -> state finished >Thread-139::DEBUG::2012-11-29 15:04:53,039::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-139::DEBUG::2012-11-29 15:04:53,040::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-139::DEBUG::2012-11-29 15:04:53,040::task::957::TaskManager.Task::(_decref) Task=`e1c26fa4-47e7-458a-94fd-555a676b87e5`::ref 0 aborting False >Thread-140::DEBUG::2012-11-29 15:04:53,089::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-140::DEBUG::2012-11-29 15:04:53,090::task::568::TaskManager.Task::(_updateState) Task=`355e3332-5685-408f-af0a-9b028fd8b845`::moving from state init -> state preparing >Thread-140::INFO::2012-11-29 15:04:53,090::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-140::DEBUG::2012-11-29 15:04:53,090::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`173649af-8c0d-46dd-8bff-da23997b9253`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-140::DEBUG::2012-11-29 15:04:53,091::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-140::DEBUG::2012-11-29 15:04:53,091::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-140::DEBUG::2012-11-29 15:04:53,091::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`173649af-8c0d-46dd-8bff-da23997b9253`::Granted request >Thread-140::DEBUG::2012-11-29 15:04:53,091::task::794::TaskManager.Task::(resourceAcquired) Task=`355e3332-5685-408f-af0a-9b028fd8b845`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (exclusive) >Thread-140::DEBUG::2012-11-29 15:04:53,092::task::957::TaskManager.Task::(_decref) Task=`355e3332-5685-408f-af0a-9b028fd8b845`::ref 1 aborting False >Thread-140::DEBUG::2012-11-29 15:04:53,092::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`df5c9a8b-95b2-4a44-9691-9a145625ce20`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-140::DEBUG::2012-11-29 15:04:53,092::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'exclusive' >Thread-140::DEBUG::2012-11-29 15:04:53,092::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'exclusive' (1 active user) >Thread-140::DEBUG::2012-11-29 15:04:53,093::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`df5c9a8b-95b2-4a44-9691-9a145625ce20`::Granted request >Thread-140::DEBUG::2012-11-29 15:04:53,093::task::794::TaskManager.Task::(resourceAcquired) Task=`355e3332-5685-408f-af0a-9b028fd8b845`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (exclusive) >Thread-140::DEBUG::2012-11-29 15:04:53,093::task::957::TaskManager.Task::(_decref) Task=`355e3332-5685-408f-af0a-9b028fd8b845`::ref 1 aborting False >Thread-140::INFO::2012-11-29 15:04:53,093::sp::1045::Storage.StoragePool::(activateSD) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 spUUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f >Thread-140::INFO::2012-11-29 15:04:53,094::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-140::DEBUG::2012-11-29 15:04:53,094::task::1151::TaskManager.Task::(prepare) Task=`355e3332-5685-408f-af0a-9b028fd8b845`::finished: None >Thread-140::DEBUG::2012-11-29 15:04:53,094::task::568::TaskManager.Task::(_updateState) Task=`355e3332-5685-408f-af0a-9b028fd8b845`::moving from state preparing -> state finished >Thread-140::DEBUG::2012-11-29 15:04:53,094::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>, 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-140::DEBUG::2012-11-29 15:04:53,094::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-140::DEBUG::2012-11-29 15:04:53,095::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-140::DEBUG::2012-11-29 15:04:53,095::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-140::DEBUG::2012-11-29 15:04:53,095::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-140::DEBUG::2012-11-29 15:04:53,095::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-140::DEBUG::2012-11-29 15:04:53,095::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-140::DEBUG::2012-11-29 15:04:53,096::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-140::DEBUG::2012-11-29 15:04:53,096::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-140::DEBUG::2012-11-29 15:04:53,096::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-140::DEBUG::2012-11-29 15:04:53,096::task::957::TaskManager.Task::(_decref) Task=`355e3332-5685-408f-af0a-9b028fd8b845`::ref 0 aborting False >Thread-141::DEBUG::2012-11-29 15:04:53,232::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-141::DEBUG::2012-11-29 15:04:53,232::task::568::TaskManager.Task::(_updateState) Task=`aecc3f62-762b-41a5-b298-c45f0b874327`::moving from state init -> state preparing >Thread-141::INFO::2012-11-29 15:04:53,232::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', hostID=1, scsiKey='b39553bd-b94c-42e1-8e06-40483d5f3c3f', msdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', masterVersion=1, options=None) >Thread-141::DEBUG::2012-11-29 15:04:53,233::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`c6391fa5-c8e2-4fd9-b285-3d355056e19f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-141::DEBUG::2012-11-29 15:04:53,233::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-141::DEBUG::2012-11-29 15:04:53,233::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-141::DEBUG::2012-11-29 15:04:53,233::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`c6391fa5-c8e2-4fd9-b285-3d355056e19f`::Granted request >Thread-141::DEBUG::2012-11-29 15:04:53,234::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 verified, version 1 >Thread-141::DEBUG::2012-11-29 15:04:53,234::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-141::DEBUG::2012-11-29 15:04:53,234::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-141::DEBUG::2012-11-29 15:04:53,234::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-141::DEBUG::2012-11-29 15:04:53,235::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-141::INFO::2012-11-29 15:04:53,235::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-141::DEBUG::2012-11-29 15:04:53,235::task::1151::TaskManager.Task::(prepare) Task=`aecc3f62-762b-41a5-b298-c45f0b874327`::finished: None >Thread-141::DEBUG::2012-11-29 15:04:53,235::task::568::TaskManager.Task::(_updateState) Task=`aecc3f62-762b-41a5-b298-c45f0b874327`::moving from state preparing -> state finished >Thread-141::DEBUG::2012-11-29 15:04:53,235::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-141::DEBUG::2012-11-29 15:04:53,236::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-141::DEBUG::2012-11-29 15:04:53,236::task::957::TaskManager.Task::(_decref) Task=`aecc3f62-762b-41a5-b298-c45f0b874327`::ref 0 aborting False >Thread-144::DEBUG::2012-11-29 15:04:57,369::task::568::TaskManager.Task::(_updateState) Task=`80e0a646-4b2e-4eca-b794-addcd9389268`::moving from state init -> state preparing >Thread-144::INFO::2012-11-29 15:04:57,370::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-144::INFO::2012-11-29 15:04:57,370::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000942945480347', 'lastCheck': '8.1', 'code': 0, 'valid': True}} >Thread-144::DEBUG::2012-11-29 15:04:57,370::task::1151::TaskManager.Task::(prepare) Task=`80e0a646-4b2e-4eca-b794-addcd9389268`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000942945480347', 'lastCheck': '8.1', 'code': 0, 'valid': True}} >Thread-144::DEBUG::2012-11-29 15:04:57,370::task::568::TaskManager.Task::(_updateState) Task=`80e0a646-4b2e-4eca-b794-addcd9389268`::moving from state preparing -> state finished >Thread-144::DEBUG::2012-11-29 15:04:57,370::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-144::DEBUG::2012-11-29 15:04:57,370::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-144::DEBUG::2012-11-29 15:04:57,371::task::957::TaskManager.Task::(_decref) Task=`80e0a646-4b2e-4eca-b794-addcd9389268`::ref 0 aborting False >Thread-147::DEBUG::2012-11-29 15:04:59,770::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-147::DEBUG::2012-11-29 15:04:59,771::task::568::TaskManager.Task::(_updateState) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::moving from state init -> state preparing >Thread-147::INFO::2012-11-29 15:04:59,771::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', size='2147483648', volFormat=4, preallocate=2, diskType=2, volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-147::INFO::2012-11-29 15:04:59,771::fileSD::302::Storage.StorageDomain::(validate) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-147::DEBUG::2012-11-29 15:04:59,772::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=e459136b318686b029466b3ded781bd95ae1ee44'] >Thread-147::DEBUG::2012-11-29 15:04:59,773::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`2b9cd47c-041d-4af2-b0d6-61e105ac376b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-147::DEBUG::2012-11-29 15:04:59,773::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-147::DEBUG::2012-11-29 15:04:59,773::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-147::DEBUG::2012-11-29 15:04:59,773::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`2b9cd47c-041d-4af2-b0d6-61e105ac376b`::Granted request >Thread-147::DEBUG::2012-11-29 15:04:59,774::task::794::TaskManager.Task::(resourceAcquired) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-147::DEBUG::2012-11-29 15:04:59,774::task::957::TaskManager.Task::(_decref) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::ref 1 aborting False >Thread-147::DEBUG::2012-11-29 15:04:59,775::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >Thread-147::DEBUG::2012-11-29 15:04:59,806::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 143ac142-9a88-4c5c-85cb-8e27da236921 >Thread-147::INFO::2012-11-29 15:04:59,806::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-147::DEBUG::2012-11-29 15:04:59,806::task::1146::TaskManager.Task::(prepare) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::Prepare: 1 jobs exist, move to acquiring >Thread-147::DEBUG::2012-11-29 15:04:59,806::task::568::TaskManager.Task::(_updateState) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::moving from state preparing -> state acquiring >Thread-147::DEBUG::2012-11-29 15:04:59,807::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >Thread-147::DEBUG::2012-11-29 15:04:59,823::task::568::TaskManager.Task::(_updateState) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::moving from state acquiring -> state queued >Thread-147::DEBUG::2012-11-29 15:04:59,824::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >Thread-147::DEBUG::2012-11-29 15:04:59,840::taskManager::50::TaskManager::(_queueTask) queuing task: 143ac142-9a88-4c5c-85cb-8e27da236921 >Thread-147::DEBUG::2012-11-29 15:04:59,840::taskManager::56::TaskManager::(_queueTask) task queued: 143ac142-9a88-4c5c-85cb-8e27da236921 >Thread-147::DEBUG::2012-11-29 15:04:59,840::task::1148::TaskManager.Task::(prepare) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::returning >Thread-147::DEBUG::2012-11-29 15:04:59,841::task::957::TaskManager.Task::(_decref) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::ref 0 aborting False >Thread-10::DEBUG::2012-11-29 15:04:59,841::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,841::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 143ac142-9a88-4c5c-85cb-8e27da236921 running: <bound method Task.commit of <storage.task.Task instance at 0x7fc0fc26c0e0>> with: None >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,842::task::1159::TaskManager.Task::(commit) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::committing task: 143ac142-9a88-4c5c-85cb-8e27da236921 >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,842::task::568::TaskManager.Task::(_updateState) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::moving from state queued -> state running >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,843::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,857::task::872::TaskManager.Task::(_runJobs) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fc0fc25a790>> (args: ('4d25f33e-850f-4088-8f0b-e9cbc8276313', '50a29df1-06f6-425d-9d8f-0684e13f85c7', 4194304, 4, 2, 2, '55fc471b-3a43-4776-9330-d2dcf3b65ea2', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,857::task::304::TaskManager.Task::(run) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fc0fc25a790>> (args: ('4d25f33e-850f-4088-8f0b-e9cbc8276313', '50a29df1-06f6-425d-9d8f-0684e13f85c7', 4194304, 4, 2, 2, '55fc471b-3a43-4776-9330-d2dcf3b65ea2', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,858::resourceManager::175::ResourceManager.Request::(__init__) ResName=`4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.50a29df1-06f6-425d-9d8f-0684e13f85c7`ReqID=`128213af-5177-4313-b450-9812f170aeae`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,858::resourceManager::486::ResourceManager::(registerResource) Trying to register resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.50a29df1-06f6-425d-9d8f-0684e13f85c7' for lock type 'exclusive' >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,859::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 50a29df1-06f6-425d-9d8f-0684e13f85c7 does not exist in domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,859::resourceManager::528::ResourceManager::(registerResource) Resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.50a29df1-06f6-425d-9d8f-0684e13f85c7' is free. Now locking as 'exclusive' (1 active user) >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,859::resourceManager::212::ResourceManager.Request::(grant) ResName=`4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.50a29df1-06f6-425d-9d8f-0684e13f85c7`ReqID=`128213af-5177-4313-b450-9812f170aeae`::Granted request >143ac142-9a88-4c5c-85cb-8e27da236921::INFO::2012-11-29 15:04:59,859::image::119::Storage.Image::(create) Create placeholder /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7 for image's volumes >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,860::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >143ac142-9a88-4c5c-85cb-8e27da236921::INFO::2012-11-29 15:04:59,884::volume::457::Storage.Volume::(create) Creating volume 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,885::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,901::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >143ac142-9a88-4c5c-85cb-8e27da236921::INFO::2012-11-29 15:04:59,918::fileVolume::153::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2 with size = 4194304 sectors >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,918::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2 2097152K' (cwd None) >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:04:59,939::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,002::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,027::fileVolume::401::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=55fc471b-3a43-4776-9330-d2dcf3b65ea2 sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313, metaId=('/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2',) >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,077::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,094::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.50a29df1-06f6-425d-9d8f-0684e13f85c7' >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,094::resourceManager::553::ResourceManager::(releaseResource) Released resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.50a29df1-06f6-425d-9d8f-0684e13f85c7' (0 active users) >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,094::resourceManager::558::ResourceManager::(releaseResource) Resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.50a29df1-06f6-425d-9d8f-0684e13f85c7' is free, finding out if anyone is waiting for it. >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,095::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.50a29df1-06f6-425d-9d8f-0684e13f85c7', Clearing records. >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,095::task::568::TaskManager.Task::(_updateState) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::moving from state running -> state finished >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,096::task::719::TaskManager.Task::(_save) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/143ac142-9a88-4c5c-85cb-8e27da236921.temp >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,119::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,119::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,120::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,120::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,120::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,120::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,121::task::880::TaskManager.Task::(_runJobs) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::Task.run: exit - success: result {'uuid': '55fc471b-3a43-4776-9330-d2dcf3b65ea2'} >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,121::task::957::TaskManager.Task::(_decref) Task=`143ac142-9a88-4c5c-85cb-8e27da236921`::ref 0 aborting False >143ac142-9a88-4c5c-85cb-8e27da236921::DEBUG::2012-11-29 15:05:00,121::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-149::DEBUG::2012-11-29 15:05:03,126::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-149::DEBUG::2012-11-29 15:05:03,126::task::568::TaskManager.Task::(_updateState) Task=`972fc5f6-b526-4d7d-9576-fe0740270cc3`::moving from state init -> state preparing >Thread-149::INFO::2012-11-29 15:05:03,127::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-149::INFO::2012-11-29 15:05:03,127::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-149::DEBUG::2012-11-29 15:05:03,127::task::1151::TaskManager.Task::(prepare) Task=`972fc5f6-b526-4d7d-9576-fe0740270cc3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-149::DEBUG::2012-11-29 15:05:03,127::task::568::TaskManager.Task::(_updateState) Task=`972fc5f6-b526-4d7d-9576-fe0740270cc3`::moving from state preparing -> state finished >Thread-149::DEBUG::2012-11-29 15:05:03,127::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-149::DEBUG::2012-11-29 15:05:03,128::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-149::DEBUG::2012-11-29 15:05:03,128::task::957::TaskManager.Task::(_decref) Task=`972fc5f6-b526-4d7d-9576-fe0740270cc3`::ref 0 aborting False >Thread-150::DEBUG::2012-11-29 15:05:03,159::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-150::DEBUG::2012-11-29 15:05:03,159::task::568::TaskManager.Task::(_updateState) Task=`8e584889-d37b-4028-9439-525d6107f162`::moving from state init -> state preparing >Thread-150::INFO::2012-11-29 15:05:03,159::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-150::DEBUG::2012-11-29 15:05:03,160::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`904cd477-5fba-449b-b110-721cf1bfe53b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-150::DEBUG::2012-11-29 15:05:03,160::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-150::DEBUG::2012-11-29 15:05:03,160::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-150::DEBUG::2012-11-29 15:05:03,160::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`904cd477-5fba-449b-b110-721cf1bfe53b`::Granted request >Thread-150::DEBUG::2012-11-29 15:05:03,161::task::794::TaskManager.Task::(resourceAcquired) Task=`8e584889-d37b-4028-9439-525d6107f162`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-150::DEBUG::2012-11-29 15:05:03,161::task::957::TaskManager.Task::(_decref) Task=`8e584889-d37b-4028-9439-525d6107f162`::ref 1 aborting False >Thread-150::INFO::2012-11-29 15:05:03,162::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459336957952', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-150::DEBUG::2012-11-29 15:05:03,162::task::1151::TaskManager.Task::(prepare) Task=`8e584889-d37b-4028-9439-525d6107f162`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459336957952', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-150::DEBUG::2012-11-29 15:05:03,162::task::568::TaskManager.Task::(_updateState) Task=`8e584889-d37b-4028-9439-525d6107f162`::moving from state preparing -> state finished >Thread-150::DEBUG::2012-11-29 15:05:03,162::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-150::DEBUG::2012-11-29 15:05:03,162::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-150::DEBUG::2012-11-29 15:05:03,163::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-150::DEBUG::2012-11-29 15:05:03,163::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-150::DEBUG::2012-11-29 15:05:03,163::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-150::DEBUG::2012-11-29 15:05:03,163::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-150::DEBUG::2012-11-29 15:05:03,163::task::957::TaskManager.Task::(_decref) Task=`8e584889-d37b-4028-9439-525d6107f162`::ref 0 aborting False >Thread-152::DEBUG::2012-11-29 15:05:05,520::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-152::DEBUG::2012-11-29 15:05:05,521::task::568::TaskManager.Task::(_updateState) Task=`47d05fa7-7ceb-4411-95fb-9b68cb205d26`::moving from state init -> state preparing >Thread-152::INFO::2012-11-29 15:05:05,521::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-152::DEBUG::2012-11-29 15:05:05,521::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-152::DEBUG::2012-11-29 15:05:05,522::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 143ac142-9a88-4c5c-85cb-8e27da236921 >Thread-152::DEBUG::2012-11-29 15:05:05,522::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '143ac142-9a88-4c5c-85cb-8e27da236921'} >Thread-152::DEBUG::2012-11-29 15:05:05,522::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'143ac142-9a88-4c5c-85cb-8e27da236921': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '143ac142-9a88-4c5c-85cb-8e27da236921'}} >Thread-152::INFO::2012-11-29 15:05:05,522::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'143ac142-9a88-4c5c-85cb-8e27da236921': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '143ac142-9a88-4c5c-85cb-8e27da236921'}}} >Thread-152::DEBUG::2012-11-29 15:05:05,522::task::1151::TaskManager.Task::(prepare) Task=`47d05fa7-7ceb-4411-95fb-9b68cb205d26`::finished: {'allTasksStatus': {'143ac142-9a88-4c5c-85cb-8e27da236921': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '143ac142-9a88-4c5c-85cb-8e27da236921'}}} >Thread-152::DEBUG::2012-11-29 15:05:05,522::task::568::TaskManager.Task::(_updateState) Task=`47d05fa7-7ceb-4411-95fb-9b68cb205d26`::moving from state preparing -> state finished >Thread-152::DEBUG::2012-11-29 15:05:05,522::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-152::DEBUG::2012-11-29 15:05:05,523::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-152::DEBUG::2012-11-29 15:05:05,523::task::957::TaskManager.Task::(_decref) Task=`47d05fa7-7ceb-4411-95fb-9b68cb205d26`::ref 0 aborting False >Thread-154::DEBUG::2012-11-29 15:05:05,600::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-154::DEBUG::2012-11-29 15:05:05,600::task::568::TaskManager.Task::(_updateState) Task=`b9ed9fcb-e5ae-4c1e-b211-c8edaca815f5`::moving from state init -> state preparing >Thread-154::INFO::2012-11-29 15:05:05,600::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2', options=None) >Thread-154::DEBUG::2012-11-29 15:05:05,600::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`0d4638ab-19dc-4535-9810-bfdd10aacc23`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-154::DEBUG::2012-11-29 15:05:05,601::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-154::DEBUG::2012-11-29 15:05:05,601::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-154::DEBUG::2012-11-29 15:05:05,601::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`0d4638ab-19dc-4535-9810-bfdd10aacc23`::Granted request >Thread-154::DEBUG::2012-11-29 15:05:05,601::task::794::TaskManager.Task::(resourceAcquired) Task=`b9ed9fcb-e5ae-4c1e-b211-c8edaca815f5`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-154::DEBUG::2012-11-29 15:05:05,602::task::957::TaskManager.Task::(_decref) Task=`b9ed9fcb-e5ae-4c1e-b211-c8edaca815f5`::ref 1 aborting False >Thread-154::DEBUG::2012-11-29 15:05:05,603::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-154::INFO::2012-11-29 15:05:05,603::volume::795::Storage.Volume::(getInfo) Info request: sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 imgUUID=50a29df1-06f6-425d-9d8f-0684e13f85c7 volUUID = 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-154::DEBUG::2012-11-29 15:05:05,609::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-154::DEBUG::2012-11-29 15:05:05,612::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-154::INFO::2012-11-29 15:05:05,613::volume::824::Storage.Volume::(getInfo) 4d25f33e-850f-4088-8f0b-e9cbc8276313/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2 info is {'status': 'OK', 'domain': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'ctime': '1354194300', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354194300', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'truesize': '139264', 'type': 'SPARSE'} >Thread-154::INFO::2012-11-29 15:05:05,613::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'ctime': '1354194300', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354194300', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'truesize': '139264', 'type': 'SPARSE'}} >Thread-154::DEBUG::2012-11-29 15:05:05,614::task::1151::TaskManager.Task::(prepare) Task=`b9ed9fcb-e5ae-4c1e-b211-c8edaca815f5`::finished: {'info': {'status': 'OK', 'domain': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'ctime': '1354194300', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1354194300', 'apparentsize': '262144', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'truesize': '139264', 'type': 'SPARSE'}} >Thread-154::DEBUG::2012-11-29 15:05:05,614::task::568::TaskManager.Task::(_updateState) Task=`b9ed9fcb-e5ae-4c1e-b211-c8edaca815f5`::moving from state preparing -> state finished >Thread-154::DEBUG::2012-11-29 15:05:05,614::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-154::DEBUG::2012-11-29 15:05:05,614::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-154::DEBUG::2012-11-29 15:05:05,614::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-154::DEBUG::2012-11-29 15:05:05,614::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-154::DEBUG::2012-11-29 15:05:05,615::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-154::DEBUG::2012-11-29 15:05:05,615::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-154::DEBUG::2012-11-29 15:05:05,615::task::957::TaskManager.Task::(_decref) Task=`b9ed9fcb-e5ae-4c1e-b211-c8edaca815f5`::ref 0 aborting False >Thread-155::DEBUG::2012-11-29 15:05:05,812::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-155::DEBUG::2012-11-29 15:05:05,812::task::568::TaskManager.Task::(_updateState) Task=`3a60c7b1-9c24-43e2-99b6-6bbbe86b5a90`::moving from state init -> state preparing >Thread-155::INFO::2012-11-29 15:05:05,813::logUtils::37::dispatcher::(wrapper) Run and protect: updateVM(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', vmList=[{'imglist': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.1.0.0"><References><File ovf:href="50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2" ovf:id="55fc471b-3a43-4776-9330-d2dcf3b65ea2" ovf:size="2147483648" ovf:description="Active VM"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="55fc471b-3a43-4776-9330-d2dcf3b65ea2" ovf:size="2" ovf:actual_size="0" ovf:vm_snapshot_id="ed2c8e89-4ffe-428b-a66d-d37be2cb6075" ovf:parentRef="" ovf:fileRef="50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="false" ovf:disk-alias="restvm_LOCAL_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Name>restvm_LOCAL</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><Description>Test VM LOCAL</Description><Domain></Domain><CreationDate>2012/11/29 13:04:57</CreationDate><ExportDate>2012/11/29 13:05:05</ExportDate><IsInitilized>false</IsInitilized><IsAutoSuspend>false</IsAutoSuspend><TimeZone></TimeZone><IsStateless>false</IsStateless><Origin>0</Origin><default_boot_sequence>0</default_boot_sequence><quota_id>00000000-0000-0000-0000-000000000000</quota_id><VmType>0</VmType><DefaultDisplayType>1</DefaultDisplayType><MinAllocatedMem>1024</MinAllocatedMem><Section ovf:id="302eb6e8-593b-42dc-acef-b27ca1440fa8" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>Unassigned</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.1.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>restvm_LOCAL_Disk1</rasd:Caption><rasd:InstanceId>55fc471b-3a43-4776-9330-d2dcf3b65ea2</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>4d25f33e-850f-4088-8f0b-e9cbc8276313</rasd:StorageId><rasd:StoragePoolId>b39553bd-b94c-42e1-8e06-40483d5f3c3f</rasd:StoragePoolId><rasd:CreationDate>2012/11/29 13:05:00</rasd:CreationDate><rasd:LastModified>2012/11/29 13:05:00</rasd:LastModified><rasd:last_modified_date>2012/11/29 13:05:05</rasd:last_modified_date></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>\n', 'vm': '302eb6e8-593b-42dc-acef-b27ca1440fa8'}], sdUUID=None, options=None) >Thread-155::DEBUG::2012-11-29 15:05:05,813::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`a27897f6-4a36-4659-8396-0cf72ee1a397`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-155::DEBUG::2012-11-29 15:05:05,813::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-155::DEBUG::2012-11-29 15:05:05,813::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-155::DEBUG::2012-11-29 15:05:05,813::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`a27897f6-4a36-4659-8396-0cf72ee1a397`::Granted request >Thread-155::DEBUG::2012-11-29 15:05:05,814::task::794::TaskManager.Task::(resourceAcquired) Task=`3a60c7b1-9c24-43e2-99b6-6bbbe86b5a90`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-155::DEBUG::2012-11-29 15:05:05,814::task::957::TaskManager.Task::(_decref) Task=`3a60c7b1-9c24-43e2-99b6-6bbbe86b5a90`::ref 1 aborting False >Thread-155::INFO::2012-11-29 15:05:05,814::sp::1258::Storage.StoragePool::(updateVM) spUUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-155::INFO::2012-11-29 15:05:05,814::sp::1269::Storage.StoragePool::(updateVM) vmUUID=302eb6e8-593b-42dc-acef-b27ca1440fa8 imgList=['50a29df1-06f6-425d-9d8f-0684e13f85c7'] >Thread-155::INFO::2012-11-29 15:05:05,815::logUtils::39::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-155::DEBUG::2012-11-29 15:05:05,815::task::1151::TaskManager.Task::(prepare) Task=`3a60c7b1-9c24-43e2-99b6-6bbbe86b5a90`::finished: None >Thread-155::DEBUG::2012-11-29 15:05:05,815::task::568::TaskManager.Task::(_updateState) Task=`3a60c7b1-9c24-43e2-99b6-6bbbe86b5a90`::moving from state preparing -> state finished >Thread-155::DEBUG::2012-11-29 15:05:05,815::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-155::DEBUG::2012-11-29 15:05:05,815::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2012-11-29 15:05:05,816::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-155::DEBUG::2012-11-29 15:05:05,816::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-155::DEBUG::2012-11-29 15:05:05,816::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-155::DEBUG::2012-11-29 15:05:05,816::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-155::DEBUG::2012-11-29 15:05:05,816::task::957::TaskManager.Task::(_decref) Task=`3a60c7b1-9c24-43e2-99b6-6bbbe86b5a90`::ref 0 aborting False >Thread-156::DEBUG::2012-11-29 15:05:05,874::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-156::DEBUG::2012-11-29 15:05:05,875::task::568::TaskManager.Task::(_updateState) Task=`509d0e85-80fd-495c-b6d6-bff728455b0b`::moving from state init -> state preparing >Thread-156::INFO::2012-11-29 15:05:05,875::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='143ac142-9a88-4c5c-85cb-8e27da236921', spUUID=None, options=None) >Thread-156::DEBUG::2012-11-29 15:05:05,875::taskManager::161::TaskManager::(clearTask) Entry. taskID: 143ac142-9a88-4c5c-85cb-8e27da236921 >Thread-156::DEBUG::2012-11-29 15:05:05,876::taskManager::166::TaskManager::(clearTask) Return. >Thread-156::INFO::2012-11-29 15:05:05,876::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-156::DEBUG::2012-11-29 15:05:05,876::task::1151::TaskManager.Task::(prepare) Task=`509d0e85-80fd-495c-b6d6-bff728455b0b`::finished: None >Thread-156::DEBUG::2012-11-29 15:05:05,876::task::568::TaskManager.Task::(_updateState) Task=`509d0e85-80fd-495c-b6d6-bff728455b0b`::moving from state preparing -> state finished >Thread-156::DEBUG::2012-11-29 15:05:05,876::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-156::DEBUG::2012-11-29 15:05:05,877::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-156::DEBUG::2012-11-29 15:05:05,877::task::957::TaskManager.Task::(_decref) Task=`509d0e85-80fd-495c-b6d6-bff728455b0b`::ref 0 aborting False >Thread-157::DEBUG::2012-11-29 15:05:07,628::task::568::TaskManager.Task::(_updateState) Task=`98cfb40c-6d19-4485-982f-9b3a1764c07b`::moving from state init -> state preparing >Thread-157::INFO::2012-11-29 15:05:07,629::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-157::INFO::2012-11-29 15:05:07,629::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00103211402893', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-157::DEBUG::2012-11-29 15:05:07,629::task::1151::TaskManager.Task::(prepare) Task=`98cfb40c-6d19-4485-982f-9b3a1764c07b`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00103211402893', 'lastCheck': '8.3', 'code': 0, 'valid': True}} >Thread-157::DEBUG::2012-11-29 15:05:07,629::task::568::TaskManager.Task::(_updateState) Task=`98cfb40c-6d19-4485-982f-9b3a1764c07b`::moving from state preparing -> state finished >Thread-157::DEBUG::2012-11-29 15:05:07,629::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-157::DEBUG::2012-11-29 15:05:07,630::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-157::DEBUG::2012-11-29 15:05:07,630::task::957::TaskManager.Task::(_decref) Task=`98cfb40c-6d19-4485-982f-9b3a1764c07b`::ref 0 aborting False >Thread-160::DEBUG::2012-11-29 15:05:11,479::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmCreate with ({'custom': {}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.3.0', 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'devices': [{'device': 'qxl', 'specParams': {'vram': '65536'}, 'type': 'video', 'deviceId': '0e9a6899-6786-4ca4-bc9e-977f0ee8816d'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'a10db588-8d57-46ee-9de5-07b96e5bd78d', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'iface': 'virtio', 'format': 'cow', 'type': 'disk', 'volumeID': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'specParams': {}, 'readonly': 'false', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'deviceId': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'poolID': 'b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': 'dbc7f9a3-594b-417e-8e76-2a20304cc634'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'fe3a1b1a-6697-400a-af4b-9c948b2ee444'}], 'smp': '1', 'vmType': 'kvm', 'timeOffset': '0', 'memSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'restvm_LOCAL', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [204] >Thread-160::INFO::2012-11-29 15:05:11,479::API::604::vds::(_getNetworkIp) network None: using 0 >Thread-160::INFO::2012-11-29 15:05:11,479::clientIF::346::vds::(createVm) vmContainerLock acquired by vm 302eb6e8-593b-42dc-acef-b27ca1440fa8 >Thread-161::DEBUG::2012-11-29 15:05:11,502::vm::635::vm.Vm::(_startUnderlyingVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Start >Thread-160::DEBUG::2012-11-29 15:05:11,502::clientIF::360::vds::(createVm) Total desktops after creation of 302eb6e8-593b-42dc-acef-b27ca1440fa8 is 1 >Thread-160::DEBUG::2012-11-29 15:05:11,502::BindingXMLRPC::910::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.3.0', 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'pid': '0', 'timeOffset': '0', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '65536'}, 'type': 'video', 'deviceId': '0e9a6899-6786-4ca4-bc9e-977f0ee8816d'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'a10db588-8d57-46ee-9de5-07b96e5bd78d', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'iface': 'virtio', 'format': 'cow', 'type': 'disk', 'volumeID': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'specParams': {}, 'readonly': 'false', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'deviceId': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'poolID': 'b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': 'dbc7f9a3-594b-417e-8e76-2a20304cc634'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'fe3a1b1a-6697-400a-af4b-9c948b2ee444'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'restvm_LOCAL', 'display': 'qxl', 'nice': '0'}} >Thread-161::DEBUG::2012-11-29 15:05:11,503::vm::639::vm.Vm::(_startUnderlyingVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::_ongoingCreations acquired >Thread-161::INFO::2012-11-29 15:05:11,504::libvirtvm::1361::vm.Vm::(_run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::VM wrapper has started >Thread-161::DEBUG::2012-11-29 15:05:11,504::task::568::TaskManager.Task::(_updateState) Task=`6604f86d-0797-47e0-a4c5-51be4e2b3b29`::moving from state init -> state preparing >Thread-161::INFO::2012-11-29 15:05:11,505::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2', options=None) >Thread-161::DEBUG::2012-11-29 15:05:11,507::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-161::INFO::2012-11-29 15:05:11,508::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '139264', 'apparentsize': '262144'} >Thread-161::DEBUG::2012-11-29 15:05:11,508::task::1151::TaskManager.Task::(prepare) Task=`6604f86d-0797-47e0-a4c5-51be4e2b3b29`::finished: {'truesize': '139264', 'apparentsize': '262144'} >Thread-161::DEBUG::2012-11-29 15:05:11,508::task::568::TaskManager.Task::(_updateState) Task=`6604f86d-0797-47e0-a4c5-51be4e2b3b29`::moving from state preparing -> state finished >Thread-161::DEBUG::2012-11-29 15:05:11,509::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-161::DEBUG::2012-11-29 15:05:11,509::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2012-11-29 15:05:11,509::task::957::TaskManager.Task::(_decref) Task=`6604f86d-0797-47e0-a4c5-51be4e2b3b29`::ref 0 aborting False >Thread-161::INFO::2012-11-29 15:05:11,509::clientIF::328::vds::(prepareVolumePath) prepared volume path: >Thread-161::DEBUG::2012-11-29 15:05:11,509::task::568::TaskManager.Task::(_updateState) Task=`1408ad29-2955-4176-8846-d34d74c3c2b2`::moving from state init -> state preparing >Thread-161::INFO::2012-11-29 15:05:11,510::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2') >Thread-161::DEBUG::2012-11-29 15:05:11,510::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`a3555761-07fa-4dbd-bca9-56bc248ec648`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-161::DEBUG::2012-11-29 15:05:11,510::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-161::DEBUG::2012-11-29 15:05:11,510::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-161::DEBUG::2012-11-29 15:05:11,510::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`a3555761-07fa-4dbd-bca9-56bc248ec648`::Granted request >Thread-161::DEBUG::2012-11-29 15:05:11,511::task::794::TaskManager.Task::(resourceAcquired) Task=`1408ad29-2955-4176-8846-d34d74c3c2b2`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-161::DEBUG::2012-11-29 15:05:11,511::task::957::TaskManager.Task::(_decref) Task=`1408ad29-2955-4176-8846-d34d74c3c2b2`::ref 1 aborting False >Thread-161::DEBUG::2012-11-29 15:05:11,512::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-161::INFO::2012-11-29 15:05:11,528::image::344::Storage.Image::(getChain) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 imgUUID=50a29df1-06f6-425d-9d8f-0684e13f85c7 chain=[<storage.fileVolume.FileVolume object at 0x7fc0fc380c50>] >Thread-161::INFO::2012-11-29 15:05:11,529::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'chain': [{'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'volumeID': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}]} >Thread-161::DEBUG::2012-11-29 15:05:11,529::task::1151::TaskManager.Task::(prepare) Task=`1408ad29-2955-4176-8846-d34d74c3c2b2`::finished: {'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'chain': [{'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'volumeID': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}]} >Thread-161::DEBUG::2012-11-29 15:05:11,529::task::568::TaskManager.Task::(_updateState) Task=`1408ad29-2955-4176-8846-d34d74c3c2b2`::moving from state preparing -> state finished >Thread-161::DEBUG::2012-11-29 15:05:11,529::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-161::DEBUG::2012-11-29 15:05:11,530::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2012-11-29 15:05:11,530::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-161::DEBUG::2012-11-29 15:05:11,530::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-161::DEBUG::2012-11-29 15:05:11,530::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-161::DEBUG::2012-11-29 15:05:11,530::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-161::DEBUG::2012-11-29 15:05:11,531::task::957::TaskManager.Task::(_decref) Task=`1408ad29-2955-4176-8846-d34d74c3c2b2`::ref 0 aborting False >Thread-161::INFO::2012-11-29 15:05:11,531::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-161::DEBUG::2012-11-29 15:05:11,537::libvirtvm::1415::vm.Vm::(_run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>restvm_LOCAL</name> > <uuid>302eb6e8-593b-42dc-acef-b27ca1440fa8</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu>1</vcpu> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/restvm_LOCAL.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/restvm_LOCAL.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <console type="pty"> > <target port="0" type="virtio"/> > </console> > <sound model="ich6"/> > <video> > <model heads="1" type="qxl" vram="65536"/> > </video> > <memballoon model="virtio"/> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial></serial> > </disk> > <disk device="disk" snapshot="no" type="file"> > <source file="/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2"/> > <target bus="virtio" dev="vda"/> > <serial>50a29df1-06f6-425d-9d8f-0684e13f85c7</serial> > <driver cache="none" error_policy="stop" io="threads" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.3.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6Server-6.4.0.3.el6</entry> > <entry name="serial">bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7</entry> > <entry name="uuid">302eb6e8-593b-42dc-acef-b27ca1440fa8</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="1" threads="1"/> > </cpu> ></domain> > >libvirtEventLoop::DEBUG::2012-11-29 15:05:12,036::libvirtvm::2765::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::event Started detail 0 opaque None >Thread-161::DEBUG::2012-11-29 15:05:12,082::utils::346::vm.Vm::(start) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Start statistics collection >Thread-164::DEBUG::2012-11-29 15:05:12,082::utils::375::vm.Vm::(run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Stats thread started >Thread-164::DEBUG::2012-11-29 15:05:12,083::task::568::TaskManager.Task::(_updateState) Task=`d134fe5a-efb6-47e9-87a0-68d486478940`::moving from state init -> state preparing >Thread-164::INFO::2012-11-29 15:05:12,084::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2', options=None) >Thread-161::DEBUG::2012-11-29 15:05:12,085::vmChannels::144::vds::(register) Add fileno 30 to listener's channels. >Thread-164::DEBUG::2012-11-29 15:05:12,086::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-164::INFO::2012-11-29 15:05:12,088::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '139264', 'apparentsize': '262144'} >Thread-164::DEBUG::2012-11-29 15:05:12,088::task::1151::TaskManager.Task::(prepare) Task=`d134fe5a-efb6-47e9-87a0-68d486478940`::finished: {'truesize': '139264', 'apparentsize': '262144'} >Thread-164::DEBUG::2012-11-29 15:05:12,088::task::568::TaskManager.Task::(_updateState) Task=`d134fe5a-efb6-47e9-87a0-68d486478940`::moving from state preparing -> state finished >Thread-164::DEBUG::2012-11-29 15:05:12,088::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-164::DEBUG::2012-11-29 15:05:12,089::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-164::DEBUG::2012-11-29 15:05:12,089::task::957::TaskManager.Task::(_decref) Task=`d134fe5a-efb6-47e9-87a0-68d486478940`::ref 0 aborting False >Thread-161::WARNING::2012-11-29 15:05:12,089::libvirtvm::1655::vm.Vm::(_readPauseCode) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::_readPauseCode unsupported by libvirt vm >Thread-161::DEBUG::2012-11-29 15:05:12,148::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) >Thread-161::DEBUG::2012-11-29 15:05:12,187::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-161::DEBUG::2012-11-29 15:05:12,188::vm::656::vm.Vm::(_startUnderlyingVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::_ongoingCreations released >VM Channels Listener::DEBUG::2012-11-29 15:05:12,206::vmChannels::71::vds::(_do_add_channels) fileno 30 was added to unconnected channels. >VM Channels Listener::DEBUG::2012-11-29 15:05:12,209::vmChannels::103::vds::(_handle_unconnected) Trying to connect fileno 30. >VM Channels Listener::DEBUG::2012-11-29 15:05:12,211::guestIF::95::vm.Vm::(_connect) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Attempting connection to /var/lib/libvirt/qemu/channels/restvm_LOCAL.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2012-11-29 15:05:12,212::guestIF::97::vm.Vm::(_connect) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Connected to /var/lib/libvirt/qemu/channels/restvm_LOCAL.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2012-11-29 15:05:12,214::vmChannels::106::vds::(_handle_unconnected) Connect fileno 30 was succeed. >Thread-165::DEBUG::2012-11-29 15:05:13,215::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-165::DEBUG::2012-11-29 15:05:13,216::task::568::TaskManager.Task::(_updateState) Task=`94239014-323b-4e06-89cf-ebcd7318c89c`::moving from state init -> state preparing >Thread-165::INFO::2012-11-29 15:05:13,216::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-165::INFO::2012-11-29 15:05:13,217::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-165::DEBUG::2012-11-29 15:05:13,217::task::1151::TaskManager.Task::(prepare) Task=`94239014-323b-4e06-89cf-ebcd7318c89c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-165::DEBUG::2012-11-29 15:05:13,217::task::568::TaskManager.Task::(_updateState) Task=`94239014-323b-4e06-89cf-ebcd7318c89c`::moving from state preparing -> state finished >Thread-165::DEBUG::2012-11-29 15:05:13,217::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-165::DEBUG::2012-11-29 15:05:13,217::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-165::DEBUG::2012-11-29 15:05:13,218::task::957::TaskManager.Task::(_decref) Task=`94239014-323b-4e06-89cf-ebcd7318c89c`::ref 0 aborting False >Thread-166::DEBUG::2012-11-29 15:05:13,245::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-166::DEBUG::2012-11-29 15:05:13,246::task::568::TaskManager.Task::(_updateState) Task=`11a998d1-ec53-4ae1-afb3-891281fd795e`::moving from state init -> state preparing >Thread-166::INFO::2012-11-29 15:05:13,246::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-166::DEBUG::2012-11-29 15:05:13,247::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`1daeffd3-c86b-4a19-ad0f-2b3f497ccf21`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-166::DEBUG::2012-11-29 15:05:13,247::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-166::DEBUG::2012-11-29 15:05:13,248::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-166::DEBUG::2012-11-29 15:05:13,248::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`1daeffd3-c86b-4a19-ad0f-2b3f497ccf21`::Granted request >Thread-166::DEBUG::2012-11-29 15:05:13,249::task::794::TaskManager.Task::(resourceAcquired) Task=`11a998d1-ec53-4ae1-afb3-891281fd795e`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-166::DEBUG::2012-11-29 15:05:13,249::task::957::TaskManager.Task::(_decref) Task=`11a998d1-ec53-4ae1-afb3-891281fd795e`::ref 1 aborting False >Thread-166::INFO::2012-11-29 15:05:13,251::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335667712', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-166::DEBUG::2012-11-29 15:05:13,251::task::1151::TaskManager.Task::(prepare) Task=`11a998d1-ec53-4ae1-afb3-891281fd795e`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335667712', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-166::DEBUG::2012-11-29 15:05:13,252::task::568::TaskManager.Task::(_updateState) Task=`11a998d1-ec53-4ae1-afb3-891281fd795e`::moving from state preparing -> state finished >Thread-166::DEBUG::2012-11-29 15:05:13,252::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-166::DEBUG::2012-11-29 15:05:13,252::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-166::DEBUG::2012-11-29 15:05:13,253::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-166::DEBUG::2012-11-29 15:05:13,253::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-166::DEBUG::2012-11-29 15:05:13,253::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-166::DEBUG::2012-11-29 15:05:13,254::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-166::DEBUG::2012-11-29 15:05:13,254::task::957::TaskManager.Task::(_decref) Task=`11a998d1-ec53-4ae1-afb3-891281fd795e`::ref 0 aborting False >Thread-168::DEBUG::2012-11-29 15:05:13,853::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-168::DEBUG::2012-11-29 15:05:13,853::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-168::DEBUG::2012-11-29 15:05:13,853::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-168::DEBUG::2012-11-29 15:05:13,854::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-168::DEBUG::2012-11-29 15:05:13,854::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-168::DEBUG::2012-11-29 15:05:13,854::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-168::DEBUG::2012-11-29 15:05:13,854::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.77', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-171::DEBUG::2012-11-29 15:05:16,106::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-171::DEBUG::2012-11-29 15:05:16,106::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-171::DEBUG::2012-11-29 15:05:16,106::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-171::DEBUG::2012-11-29 15:05:16,107::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-171::DEBUG::2012-11-29 15:05:16,107::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-171::DEBUG::2012-11-29 15:05:16,107::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-171::DEBUG::2012-11-29 15:05:16,107::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.93', 'elapsedTime': '4', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-172::DEBUG::2012-11-29 15:05:18,150::task::568::TaskManager.Task::(_updateState) Task=`30dad3df-3436-4dfa-91e3-91e0489e6eac`::moving from state init -> state preparing >Thread-172::INFO::2012-11-29 15:05:18,150::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-172::INFO::2012-11-29 15:05:18,150::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0125758647919', 'lastCheck': '8.8', 'code': 0, 'valid': True}} >Thread-172::DEBUG::2012-11-29 15:05:18,150::task::1151::TaskManager.Task::(prepare) Task=`30dad3df-3436-4dfa-91e3-91e0489e6eac`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0125758647919', 'lastCheck': '8.8', 'code': 0, 'valid': True}} >Thread-172::DEBUG::2012-11-29 15:05:18,151::task::568::TaskManager.Task::(_updateState) Task=`30dad3df-3436-4dfa-91e3-91e0489e6eac`::moving from state preparing -> state finished >Thread-172::DEBUG::2012-11-29 15:05:18,151::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-172::DEBUG::2012-11-29 15:05:18,151::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-172::DEBUG::2012-11-29 15:05:18,151::task::957::TaskManager.Task::(_decref) Task=`30dad3df-3436-4dfa-91e3-91e0489e6eac`::ref 0 aborting False >Thread-173::DEBUG::2012-11-29 15:05:18,193::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-173::DEBUG::2012-11-29 15:05:18,194::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-173::DEBUG::2012-11-29 15:05:18,194::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-173::DEBUG::2012-11-29 15:05:18,194::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-173::DEBUG::2012-11-29 15:05:18,194::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-175::DEBUG::2012-11-29 15:05:20,298::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-175::DEBUG::2012-11-29 15:05:20,298::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-175::DEBUG::2012-11-29 15:05:20,299::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-175::DEBUG::2012-11-29 15:05:20,299::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-175::DEBUG::2012-11-29 15:05:20,299::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-175::DEBUG::2012-11-29 15:05:20,299::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-175::DEBUG::2012-11-29 15:05:20,299::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.12', 'elapsedTime': '8', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-177::DEBUG::2012-11-29 15:05:22,383::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-177::DEBUG::2012-11-29 15:05:22,383::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-177::DEBUG::2012-11-29 15:05:22,383::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-177::DEBUG::2012-11-29 15:05:22,384::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-177::DEBUG::2012-11-29 15:05:22,384::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-177::DEBUG::2012-11-29 15:05:22,384::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-177::DEBUG::2012-11-29 15:05:22,384::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-178::DEBUG::2012-11-29 15:05:22,480::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-178::DEBUG::2012-11-29 15:05:22,481::task::568::TaskManager.Task::(_updateState) Task=`12cf3577-9c59-4b5b-b947-5247de40ca4d`::moving from state init -> state preparing >Thread-178::INFO::2012-11-29 15:05:22,481::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-178::DEBUG::2012-11-29 15:05:22,481::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-178::DEBUG::2012-11-29 15:05:22,481::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-178::INFO::2012-11-29 15:05:22,481::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-178::DEBUG::2012-11-29 15:05:22,482::task::1151::TaskManager.Task::(prepare) Task=`12cf3577-9c59-4b5b-b947-5247de40ca4d`::finished: {'allTasksStatus': {}} >Thread-178::DEBUG::2012-11-29 15:05:22,482::task::568::TaskManager.Task::(_updateState) Task=`12cf3577-9c59-4b5b-b947-5247de40ca4d`::moving from state preparing -> state finished >Thread-178::DEBUG::2012-11-29 15:05:22,482::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-178::DEBUG::2012-11-29 15:05:22,482::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-178::DEBUG::2012-11-29 15:05:22,482::task::957::TaskManager.Task::(_decref) Task=`12cf3577-9c59-4b5b-b947-5247de40ca4d`::ref 0 aborting False >Thread-179::DEBUG::2012-11-29 15:05:23,303::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-179::DEBUG::2012-11-29 15:05:23,303::task::568::TaskManager.Task::(_updateState) Task=`48153945-f323-4ace-89e8-ed7511d1d029`::moving from state init -> state preparing >Thread-179::INFO::2012-11-29 15:05:23,303::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-179::INFO::2012-11-29 15:05:23,304::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-179::DEBUG::2012-11-29 15:05:23,304::task::1151::TaskManager.Task::(prepare) Task=`48153945-f323-4ace-89e8-ed7511d1d029`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-179::DEBUG::2012-11-29 15:05:23,304::task::568::TaskManager.Task::(_updateState) Task=`48153945-f323-4ace-89e8-ed7511d1d029`::moving from state preparing -> state finished >Thread-179::DEBUG::2012-11-29 15:05:23,304::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-179::DEBUG::2012-11-29 15:05:23,304::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-179::DEBUG::2012-11-29 15:05:23,304::task::957::TaskManager.Task::(_decref) Task=`48153945-f323-4ace-89e8-ed7511d1d029`::ref 0 aborting False >Thread-180::DEBUG::2012-11-29 15:05:23,336::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-180::DEBUG::2012-11-29 15:05:23,336::task::568::TaskManager.Task::(_updateState) Task=`fb5d888f-0ba5-4dd1-b84e-fa9a183fb43a`::moving from state init -> state preparing >Thread-180::INFO::2012-11-29 15:05:23,336::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-180::DEBUG::2012-11-29 15:05:23,337::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`3760d393-5c99-4c29-bab9-91d5345f8196`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-180::DEBUG::2012-11-29 15:05:23,337::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-180::DEBUG::2012-11-29 15:05:23,337::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-180::DEBUG::2012-11-29 15:05:23,337::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`3760d393-5c99-4c29-bab9-91d5345f8196`::Granted request >Thread-180::DEBUG::2012-11-29 15:05:23,338::task::794::TaskManager.Task::(resourceAcquired) Task=`fb5d888f-0ba5-4dd1-b84e-fa9a183fb43a`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-180::DEBUG::2012-11-29 15:05:23,338::task::957::TaskManager.Task::(_decref) Task=`fb5d888f-0ba5-4dd1-b84e-fa9a183fb43a`::ref 1 aborting False >Thread-180::INFO::2012-11-29 15:05:23,338::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335352320', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-180::DEBUG::2012-11-29 15:05:23,339::task::1151::TaskManager.Task::(prepare) Task=`fb5d888f-0ba5-4dd1-b84e-fa9a183fb43a`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335352320', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-180::DEBUG::2012-11-29 15:05:23,339::task::568::TaskManager.Task::(_updateState) Task=`fb5d888f-0ba5-4dd1-b84e-fa9a183fb43a`::moving from state preparing -> state finished >Thread-180::DEBUG::2012-11-29 15:05:23,339::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-180::DEBUG::2012-11-29 15:05:23,339::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-180::DEBUG::2012-11-29 15:05:23,339::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-180::DEBUG::2012-11-29 15:05:23,340::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-180::DEBUG::2012-11-29 15:05:23,340::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-180::DEBUG::2012-11-29 15:05:23,340::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-180::DEBUG::2012-11-29 15:05:23,340::task::957::TaskManager.Task::(_decref) Task=`fb5d888f-0ba5-4dd1-b84e-fa9a183fb43a`::ref 0 aborting False >Thread-182::DEBUG::2012-11-29 15:05:24,452::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-182::DEBUG::2012-11-29 15:05:24,452::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-182::DEBUG::2012-11-29 15:05:24,452::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-182::DEBUG::2012-11-29 15:05:24,452::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-182::DEBUG::2012-11-29 15:05:24,453::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-182::DEBUG::2012-11-29 15:05:24,453::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-182::DEBUG::2012-11-29 15:05:24,453::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.28', 'elapsedTime': '12', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-184::DEBUG::2012-11-29 15:05:26,521::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-184::DEBUG::2012-11-29 15:05:26,522::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-184::DEBUG::2012-11-29 15:05:26,522::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-184::DEBUG::2012-11-29 15:05:26,522::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-184::DEBUG::2012-11-29 15:05:26,522::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-184::DEBUG::2012-11-29 15:05:26,523::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-184::DEBUG::2012-11-29 15:05:26,523::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.35', 'elapsedTime': '15', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-185::DEBUG::2012-11-29 15:05:28,564::task::568::TaskManager.Task::(_updateState) Task=`d284e4ac-cb8c-4108-996d-1174d5d327d5`::moving from state init -> state preparing >Thread-185::INFO::2012-11-29 15:05:28,565::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-185::INFO::2012-11-29 15:05:28,565::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00116086006165', 'lastCheck': '9.3', 'code': 0, 'valid': True}} >Thread-185::DEBUG::2012-11-29 15:05:28,565::task::1151::TaskManager.Task::(prepare) Task=`d284e4ac-cb8c-4108-996d-1174d5d327d5`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00116086006165', 'lastCheck': '9.3', 'code': 0, 'valid': True}} >Thread-185::DEBUG::2012-11-29 15:05:28,565::task::568::TaskManager.Task::(_updateState) Task=`d284e4ac-cb8c-4108-996d-1174d5d327d5`::moving from state preparing -> state finished >Thread-185::DEBUG::2012-11-29 15:05:28,565::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-185::DEBUG::2012-11-29 15:05:28,565::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-185::DEBUG::2012-11-29 15:05:28,566::task::957::TaskManager.Task::(_decref) Task=`d284e4ac-cb8c-4108-996d-1174d5d327d5`::ref 0 aborting False >Thread-186::DEBUG::2012-11-29 15:05:28,596::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-186::DEBUG::2012-11-29 15:05:28,596::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-186::DEBUG::2012-11-29 15:05:28,596::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-186::DEBUG::2012-11-29 15:05:28,596::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-188::DEBUG::2012-11-29 15:05:30,691::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-188::DEBUG::2012-11-29 15:05:30,691::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-188::DEBUG::2012-11-29 15:05:30,692::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-188::DEBUG::2012-11-29 15:05:30,692::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-188::DEBUG::2012-11-29 15:05:30,692::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-188::DEBUG::2012-11-29 15:05:30,692::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '1.35', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.51', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '1.86', 'appsList': [], 'guestIPs': ''}]} >Thread-190::DEBUG::2012-11-29 15:05:32,761::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-190::DEBUG::2012-11-29 15:05:32,762::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-190::DEBUG::2012-11-29 15:05:32,762::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-190::DEBUG::2012-11-29 15:05:32,762::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-190::DEBUG::2012-11-29 15:05:32,762::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-190::DEBUG::2012-11-29 15:05:32,762::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '1.35', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.58', 'elapsedTime': '21', 'vmType': 'kvm', 'cpuSys': '1.86', 'appsList': [], 'guestIPs': ''}]} >Thread-191::DEBUG::2012-11-29 15:05:33,385::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-191::DEBUG::2012-11-29 15:05:33,385::task::568::TaskManager.Task::(_updateState) Task=`e2c17dd6-cfe2-45f7-8151-4d33fc5915b1`::moving from state init -> state preparing >Thread-191::INFO::2012-11-29 15:05:33,385::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-191::INFO::2012-11-29 15:05:33,385::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-191::DEBUG::2012-11-29 15:05:33,386::task::1151::TaskManager.Task::(prepare) Task=`e2c17dd6-cfe2-45f7-8151-4d33fc5915b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-191::DEBUG::2012-11-29 15:05:33,386::task::568::TaskManager.Task::(_updateState) Task=`e2c17dd6-cfe2-45f7-8151-4d33fc5915b1`::moving from state preparing -> state finished >Thread-191::DEBUG::2012-11-29 15:05:33,386::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-191::DEBUG::2012-11-29 15:05:33,386::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-191::DEBUG::2012-11-29 15:05:33,386::task::957::TaskManager.Task::(_decref) Task=`e2c17dd6-cfe2-45f7-8151-4d33fc5915b1`::ref 0 aborting False >Thread-192::DEBUG::2012-11-29 15:05:33,412::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-192::DEBUG::2012-11-29 15:05:33,412::task::568::TaskManager.Task::(_updateState) Task=`510df131-3bb1-416d-a22a-5c1cae32a564`::moving from state init -> state preparing >Thread-192::INFO::2012-11-29 15:05:33,413::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-192::DEBUG::2012-11-29 15:05:33,413::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`8058b489-4472-4425-8954-4353b647cddb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-192::DEBUG::2012-11-29 15:05:33,413::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-192::DEBUG::2012-11-29 15:05:33,413::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-192::DEBUG::2012-11-29 15:05:33,413::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`8058b489-4472-4425-8954-4353b647cddb`::Granted request >Thread-192::DEBUG::2012-11-29 15:05:33,414::task::794::TaskManager.Task::(resourceAcquired) Task=`510df131-3bb1-416d-a22a-5c1cae32a564`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-192::DEBUG::2012-11-29 15:05:33,414::task::957::TaskManager.Task::(_decref) Task=`510df131-3bb1-416d-a22a-5c1cae32a564`::ref 1 aborting False >Thread-192::INFO::2012-11-29 15:05:33,415::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335327744', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-192::DEBUG::2012-11-29 15:05:33,415::task::1151::TaskManager.Task::(prepare) Task=`510df131-3bb1-416d-a22a-5c1cae32a564`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335327744', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-192::DEBUG::2012-11-29 15:05:33,415::task::568::TaskManager.Task::(_updateState) Task=`510df131-3bb1-416d-a22a-5c1cae32a564`::moving from state preparing -> state finished >Thread-192::DEBUG::2012-11-29 15:05:33,415::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-192::DEBUG::2012-11-29 15:05:33,416::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-192::DEBUG::2012-11-29 15:05:33,416::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-192::DEBUG::2012-11-29 15:05:33,416::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-192::DEBUG::2012-11-29 15:05:33,416::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-192::DEBUG::2012-11-29 15:05:33,416::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-192::DEBUG::2012-11-29 15:05:33,417::task::957::TaskManager.Task::(_decref) Task=`510df131-3bb1-416d-a22a-5c1cae32a564`::ref 0 aborting False >Thread-194::DEBUG::2012-11-29 15:05:34,831::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} flowID [53aca7c] >Thread-194::DEBUG::2012-11-29 15:05:34,831::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-194::DEBUG::2012-11-29 15:05:34,831::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-194::DEBUG::2012-11-29 15:05:34,831::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-194::DEBUG::2012-11-29 15:05:34,832::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-194::DEBUG::2012-11-29 15:05:34,832::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '1.35', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.65', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '1.86', 'appsList': [], 'guestIPs': ''}]} >Thread-196::DEBUG::2012-11-29 15:05:36,901::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-196::DEBUG::2012-11-29 15:05:36,901::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-196::DEBUG::2012-11-29 15:05:36,901::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-196::DEBUG::2012-11-29 15:05:36,901::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-196::DEBUG::2012-11-29 15:05:36,901::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-196::DEBUG::2012-11-29 15:05:36,902::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '1.35', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.72', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '1.86', 'appsList': [], 'guestIPs': ''}]} >Thread-197::DEBUG::2012-11-29 15:05:38,948::task::568::TaskManager.Task::(_updateState) Task=`5d873df8-0b75-42cb-9676-58bb6b85dc8d`::moving from state init -> state preparing >Thread-197::INFO::2012-11-29 15:05:38,948::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-197::INFO::2012-11-29 15:05:38,948::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0153448581696', 'lastCheck': '9.6', 'code': 0, 'valid': True}} >Thread-197::DEBUG::2012-11-29 15:05:38,948::task::1151::TaskManager.Task::(prepare) Task=`5d873df8-0b75-42cb-9676-58bb6b85dc8d`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0153448581696', 'lastCheck': '9.6', 'code': 0, 'valid': True}} >Thread-197::DEBUG::2012-11-29 15:05:38,949::task::568::TaskManager.Task::(_updateState) Task=`5d873df8-0b75-42cb-9676-58bb6b85dc8d`::moving from state preparing -> state finished >Thread-197::DEBUG::2012-11-29 15:05:38,949::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-197::DEBUG::2012-11-29 15:05:38,949::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-197::DEBUG::2012-11-29 15:05:38,949::task::957::TaskManager.Task::(_decref) Task=`5d873df8-0b75-42cb-9676-58bb6b85dc8d`::ref 0 aborting False >Thread-198::DEBUG::2012-11-29 15:05:38,980::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-198::DEBUG::2012-11-29 15:05:38,980::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-198::DEBUG::2012-11-29 15:05:38,980::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-198::DEBUG::2012-11-29 15:05:38,980::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-200::DEBUG::2012-11-29 15:05:41,071::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-200::DEBUG::2012-11-29 15:05:41,071::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-200::DEBUG::2012-11-29 15:05:41,071::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-200::DEBUG::2012-11-29 15:05:41,071::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-200::DEBUG::2012-11-29 15:05:41,072::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-200::DEBUG::2012-11-29 15:05:41,072::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '1.35', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.89', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '1.86', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2012-11-29 15:05:42,248::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 30. >Thread-202::DEBUG::2012-11-29 15:05:43,141::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-202::DEBUG::2012-11-29 15:05:43,141::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-202::DEBUG::2012-11-29 15:05:43,141::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-202::DEBUG::2012-11-29 15:05:43,142::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-202::DEBUG::2012-11-29 15:05:43,142::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-202::DEBUG::2012-11-29 15:05:43,142::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.96', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '0.40', 'appsList': [], 'guestIPs': ''}]} >Thread-203::DEBUG::2012-11-29 15:05:43,460::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-203::DEBUG::2012-11-29 15:05:43,461::task::568::TaskManager.Task::(_updateState) Task=`a76fea9a-fed4-4b05-83a3-74fffe8eab42`::moving from state init -> state preparing >Thread-203::INFO::2012-11-29 15:05:43,461::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-203::INFO::2012-11-29 15:05:43,461::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-203::DEBUG::2012-11-29 15:05:43,461::task::1151::TaskManager.Task::(prepare) Task=`a76fea9a-fed4-4b05-83a3-74fffe8eab42`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-203::DEBUG::2012-11-29 15:05:43,462::task::568::TaskManager.Task::(_updateState) Task=`a76fea9a-fed4-4b05-83a3-74fffe8eab42`::moving from state preparing -> state finished >Thread-203::DEBUG::2012-11-29 15:05:43,462::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-203::DEBUG::2012-11-29 15:05:43,462::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-203::DEBUG::2012-11-29 15:05:43,462::task::957::TaskManager.Task::(_decref) Task=`a76fea9a-fed4-4b05-83a3-74fffe8eab42`::ref 0 aborting False >Thread-204::DEBUG::2012-11-29 15:05:43,488::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-204::DEBUG::2012-11-29 15:05:43,488::task::568::TaskManager.Task::(_updateState) Task=`bb2a051b-e9e2-4b15-a036-5e3cdfd6ab79`::moving from state init -> state preparing >Thread-204::INFO::2012-11-29 15:05:43,488::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-204::DEBUG::2012-11-29 15:05:43,489::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`ca09472b-5a56-464a-9cb5-391f32a6877d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-204::DEBUG::2012-11-29 15:05:43,489::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-204::DEBUG::2012-11-29 15:05:43,489::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-204::DEBUG::2012-11-29 15:05:43,489::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`ca09472b-5a56-464a-9cb5-391f32a6877d`::Granted request >Thread-204::DEBUG::2012-11-29 15:05:43,489::task::794::TaskManager.Task::(resourceAcquired) Task=`bb2a051b-e9e2-4b15-a036-5e3cdfd6ab79`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-204::DEBUG::2012-11-29 15:05:43,490::task::957::TaskManager.Task::(_decref) Task=`bb2a051b-e9e2-4b15-a036-5e3cdfd6ab79`::ref 1 aborting False >Thread-204::INFO::2012-11-29 15:05:43,490::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335323648', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-204::DEBUG::2012-11-29 15:05:43,490::task::1151::TaskManager.Task::(prepare) Task=`bb2a051b-e9e2-4b15-a036-5e3cdfd6ab79`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335323648', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-204::DEBUG::2012-11-29 15:05:43,491::task::568::TaskManager.Task::(_updateState) Task=`bb2a051b-e9e2-4b15-a036-5e3cdfd6ab79`::moving from state preparing -> state finished >Thread-204::DEBUG::2012-11-29 15:05:43,491::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-204::DEBUG::2012-11-29 15:05:43,491::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-204::DEBUG::2012-11-29 15:05:43,491::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-204::DEBUG::2012-11-29 15:05:43,491::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-204::DEBUG::2012-11-29 15:05:43,492::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-204::DEBUG::2012-11-29 15:05:43,492::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-204::DEBUG::2012-11-29 15:05:43,492::task::957::TaskManager.Task::(_decref) Task=`bb2a051b-e9e2-4b15-a036-5e3cdfd6ab79`::ref 0 aborting False >Thread-206::DEBUG::2012-11-29 15:05:45,209::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-206::DEBUG::2012-11-29 15:05:45,209::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-206::DEBUG::2012-11-29 15:05:45,209::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-206::DEBUG::2012-11-29 15:05:45,209::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-206::DEBUG::2012-11-29 15:05:45,210::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-206::DEBUG::2012-11-29 15:05:45,210::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.02', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '0.40', 'appsList': [], 'guestIPs': ''}]} >Thread-208::DEBUG::2012-11-29 15:05:47,277::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-208::DEBUG::2012-11-29 15:05:47,277::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-208::DEBUG::2012-11-29 15:05:47,277::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-208::DEBUG::2012-11-29 15:05:47,278::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-208::DEBUG::2012-11-29 15:05:47,278::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-208::DEBUG::2012-11-29 15:05:47,278::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.09', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '0.40', 'appsList': [], 'guestIPs': ''}]} >Thread-209::DEBUG::2012-11-29 15:05:49,321::task::568::TaskManager.Task::(_updateState) Task=`2459aed3-8997-4ce2-92a2-6227013087c9`::moving from state init -> state preparing >Thread-209::INFO::2012-11-29 15:05:49,321::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-209::INFO::2012-11-29 15:05:49,321::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000936985015869', 'lastCheck': '10.0', 'code': 0, 'valid': True}} >Thread-209::DEBUG::2012-11-29 15:05:49,321::task::1151::TaskManager.Task::(prepare) Task=`2459aed3-8997-4ce2-92a2-6227013087c9`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000936985015869', 'lastCheck': '10.0', 'code': 0, 'valid': True}} >Thread-209::DEBUG::2012-11-29 15:05:49,322::task::568::TaskManager.Task::(_updateState) Task=`2459aed3-8997-4ce2-92a2-6227013087c9`::moving from state preparing -> state finished >Thread-209::DEBUG::2012-11-29 15:05:49,322::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-209::DEBUG::2012-11-29 15:05:49,322::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-209::DEBUG::2012-11-29 15:05:49,322::task::957::TaskManager.Task::(_decref) Task=`2459aed3-8997-4ce2-92a2-6227013087c9`::ref 0 aborting False >Thread-210::DEBUG::2012-11-29 15:05:49,361::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-210::DEBUG::2012-11-29 15:05:49,361::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-210::DEBUG::2012-11-29 15:05:49,362::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-210::DEBUG::2012-11-29 15:05:49,362::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-212::DEBUG::2012-11-29 15:05:51,449::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-212::DEBUG::2012-11-29 15:05:51,449::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-212::DEBUG::2012-11-29 15:05:51,450::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-212::DEBUG::2012-11-29 15:05:51,450::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-212::DEBUG::2012-11-29 15:05:51,450::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-212::DEBUG::2012-11-29 15:05:51,450::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.26', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '0.40', 'appsList': [], 'guestIPs': ''}]} >Thread-214::DEBUG::2012-11-29 15:05:53,523::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-214::DEBUG::2012-11-29 15:05:53,523::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-214::DEBUG::2012-11-29 15:05:53,524::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-214::DEBUG::2012-11-29 15:05:53,524::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-214::DEBUG::2012-11-29 15:05:53,524::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-214::DEBUG::2012-11-29 15:05:53,525::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.34', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '0.40', 'appsList': [], 'guestIPs': ''}]} >Thread-215::DEBUG::2012-11-29 15:05:53,540::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-215::DEBUG::2012-11-29 15:05:53,540::task::568::TaskManager.Task::(_updateState) Task=`649e189b-f989-495f-a444-cf891e087e37`::moving from state init -> state preparing >Thread-215::INFO::2012-11-29 15:05:53,540::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-215::INFO::2012-11-29 15:05:53,541::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-215::DEBUG::2012-11-29 15:05:53,541::task::1151::TaskManager.Task::(prepare) Task=`649e189b-f989-495f-a444-cf891e087e37`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-215::DEBUG::2012-11-29 15:05:53,541::task::568::TaskManager.Task::(_updateState) Task=`649e189b-f989-495f-a444-cf891e087e37`::moving from state preparing -> state finished >Thread-215::DEBUG::2012-11-29 15:05:53,541::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-215::DEBUG::2012-11-29 15:05:53,541::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-215::DEBUG::2012-11-29 15:05:53,541::task::957::TaskManager.Task::(_decref) Task=`649e189b-f989-495f-a444-cf891e087e37`::ref 0 aborting False >Thread-216::DEBUG::2012-11-29 15:05:53,570::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-216::DEBUG::2012-11-29 15:05:53,570::task::568::TaskManager.Task::(_updateState) Task=`409249fa-ad73-469a-b5a4-8f8f344c95bc`::moving from state init -> state preparing >Thread-216::INFO::2012-11-29 15:05:53,570::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-216::DEBUG::2012-11-29 15:05:53,571::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`01cf1032-3b58-4b2a-a0d9-ebaabc5089f7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-216::DEBUG::2012-11-29 15:05:53,571::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-216::DEBUG::2012-11-29 15:05:53,571::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-216::DEBUG::2012-11-29 15:05:53,571::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`01cf1032-3b58-4b2a-a0d9-ebaabc5089f7`::Granted request >Thread-216::DEBUG::2012-11-29 15:05:53,572::task::794::TaskManager.Task::(resourceAcquired) Task=`409249fa-ad73-469a-b5a4-8f8f344c95bc`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-216::DEBUG::2012-11-29 15:05:53,572::task::957::TaskManager.Task::(_decref) Task=`409249fa-ad73-469a-b5a4-8f8f344c95bc`::ref 1 aborting False >Thread-216::INFO::2012-11-29 15:05:53,573::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335319552', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-216::DEBUG::2012-11-29 15:05:53,573::task::1151::TaskManager.Task::(prepare) Task=`409249fa-ad73-469a-b5a4-8f8f344c95bc`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335319552', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-216::DEBUG::2012-11-29 15:05:53,573::task::568::TaskManager.Task::(_updateState) Task=`409249fa-ad73-469a-b5a4-8f8f344c95bc`::moving from state preparing -> state finished >Thread-216::DEBUG::2012-11-29 15:05:53,573::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-216::DEBUG::2012-11-29 15:05:53,573::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-216::DEBUG::2012-11-29 15:05:53,574::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-216::DEBUG::2012-11-29 15:05:53,574::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-216::DEBUG::2012-11-29 15:05:53,574::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-216::DEBUG::2012-11-29 15:05:53,574::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-216::DEBUG::2012-11-29 15:05:53,574::task::957::TaskManager.Task::(_decref) Task=`409249fa-ad73-469a-b5a4-8f8f344c95bc`::ref 0 aborting False >Thread-218::DEBUG::2012-11-29 15:05:55,600::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-218::DEBUG::2012-11-29 15:05:55,600::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-218::DEBUG::2012-11-29 15:05:55,600::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-218::DEBUG::2012-11-29 15:05:55,600::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-218::DEBUG::2012-11-29 15:05:55,600::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-218::DEBUG::2012-11-29 15:05:55,601::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.41', 'elapsedTime': '44', 'vmType': 'kvm', 'cpuSys': '0.40', 'appsList': [], 'guestIPs': ''}]} >Thread-220::DEBUG::2012-11-29 15:05:57,666::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-220::DEBUG::2012-11-29 15:05:57,666::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-220::DEBUG::2012-11-29 15:05:57,666::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-220::DEBUG::2012-11-29 15:05:57,667::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-220::DEBUG::2012-11-29 15:05:57,667::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-220::DEBUG::2012-11-29 15:05:57,667::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.05', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.48', 'elapsedTime': '46', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-221::DEBUG::2012-11-29 15:05:59,709::task::568::TaskManager.Task::(_updateState) Task=`ffa9ed12-cbf5-4dfd-bda8-37f610ab0cdf`::moving from state init -> state preparing >Thread-221::INFO::2012-11-29 15:05:59,709::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-221::INFO::2012-11-29 15:05:59,709::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00104880332947', 'lastCheck': '0.4', 'code': 0, 'valid': True}} >Thread-221::DEBUG::2012-11-29 15:05:59,709::task::1151::TaskManager.Task::(prepare) Task=`ffa9ed12-cbf5-4dfd-bda8-37f610ab0cdf`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00104880332947', 'lastCheck': '0.4', 'code': 0, 'valid': True}} >Thread-221::DEBUG::2012-11-29 15:05:59,710::task::568::TaskManager.Task::(_updateState) Task=`ffa9ed12-cbf5-4dfd-bda8-37f610ab0cdf`::moving from state preparing -> state finished >Thread-221::DEBUG::2012-11-29 15:05:59,710::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221::DEBUG::2012-11-29 15:05:59,710::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221::DEBUG::2012-11-29 15:05:59,710::task::957::TaskManager.Task::(_decref) Task=`ffa9ed12-cbf5-4dfd-bda8-37f610ab0cdf`::ref 0 aborting False >Thread-222::DEBUG::2012-11-29 15:05:59,751::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-222::DEBUG::2012-11-29 15:05:59,752::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-222::DEBUG::2012-11-29 15:05:59,752::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-222::DEBUG::2012-11-29 15:05:59,752::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-224::DEBUG::2012-11-29 15:06:01,842::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-224::DEBUG::2012-11-29 15:06:01,842::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-224::DEBUG::2012-11-29 15:06:01,842::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-224::DEBUG::2012-11-29 15:06:01,842::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-224::DEBUG::2012-11-29 15:06:01,842::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-224::DEBUG::2012-11-29 15:06:01,843::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.05', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.65', 'elapsedTime': '50', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-225::DEBUG::2012-11-29 15:06:03,620::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-225::DEBUG::2012-11-29 15:06:03,620::task::568::TaskManager.Task::(_updateState) Task=`695d5544-5d3c-442c-8faf-d2ee14f8ac35`::moving from state init -> state preparing >Thread-225::INFO::2012-11-29 15:06:03,620::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-225::INFO::2012-11-29 15:06:03,620::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-225::DEBUG::2012-11-29 15:06:03,620::task::1151::TaskManager.Task::(prepare) Task=`695d5544-5d3c-442c-8faf-d2ee14f8ac35`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-225::DEBUG::2012-11-29 15:06:03,621::task::568::TaskManager.Task::(_updateState) Task=`695d5544-5d3c-442c-8faf-d2ee14f8ac35`::moving from state preparing -> state finished >Thread-225::DEBUG::2012-11-29 15:06:03,621::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-225::DEBUG::2012-11-29 15:06:03,621::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-225::DEBUG::2012-11-29 15:06:03,621::task::957::TaskManager.Task::(_decref) Task=`695d5544-5d3c-442c-8faf-d2ee14f8ac35`::ref 0 aborting False >Thread-226::DEBUG::2012-11-29 15:06:03,648::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-226::DEBUG::2012-11-29 15:06:03,649::task::568::TaskManager.Task::(_updateState) Task=`bba8139e-0c66-4060-a242-01f99f03ab07`::moving from state init -> state preparing >Thread-226::INFO::2012-11-29 15:06:03,649::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-226::DEBUG::2012-11-29 15:06:03,649::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`c76d48ab-ab15-4e68-9912-8197851680c2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-226::DEBUG::2012-11-29 15:06:03,649::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-226::DEBUG::2012-11-29 15:06:03,649::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-226::DEBUG::2012-11-29 15:06:03,650::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`c76d48ab-ab15-4e68-9912-8197851680c2`::Granted request >Thread-226::DEBUG::2012-11-29 15:06:03,650::task::794::TaskManager.Task::(resourceAcquired) Task=`bba8139e-0c66-4060-a242-01f99f03ab07`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-226::DEBUG::2012-11-29 15:06:03,650::task::957::TaskManager.Task::(_decref) Task=`bba8139e-0c66-4060-a242-01f99f03ab07`::ref 1 aborting False >Thread-226::INFO::2012-11-29 15:06:03,651::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335286784', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-226::DEBUG::2012-11-29 15:06:03,651::task::1151::TaskManager.Task::(prepare) Task=`bba8139e-0c66-4060-a242-01f99f03ab07`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335286784', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-226::DEBUG::2012-11-29 15:06:03,651::task::568::TaskManager.Task::(_updateState) Task=`bba8139e-0c66-4060-a242-01f99f03ab07`::moving from state preparing -> state finished >Thread-226::DEBUG::2012-11-29 15:06:03,651::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-226::DEBUG::2012-11-29 15:06:03,651::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-226::DEBUG::2012-11-29 15:06:03,652::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-226::DEBUG::2012-11-29 15:06:03,652::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-226::DEBUG::2012-11-29 15:06:03,652::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-226::DEBUG::2012-11-29 15:06:03,652::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-226::DEBUG::2012-11-29 15:06:03,652::task::957::TaskManager.Task::(_decref) Task=`bba8139e-0c66-4060-a242-01f99f03ab07`::ref 0 aborting False >Thread-228::DEBUG::2012-11-29 15:06:03,910::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-228::DEBUG::2012-11-29 15:06:03,910::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-228::DEBUG::2012-11-29 15:06:03,910::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-228::DEBUG::2012-11-29 15:06:03,910::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-228::DEBUG::2012-11-29 15:06:03,911::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-228::DEBUG::2012-11-29 15:06:03,911::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.05', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.72', 'elapsedTime': '52', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-230::DEBUG::2012-11-29 15:06:05,977::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-230::DEBUG::2012-11-29 15:06:05,977::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-230::DEBUG::2012-11-29 15:06:05,978::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-230::DEBUG::2012-11-29 15:06:05,978::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-230::DEBUG::2012-11-29 15:06:05,978::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-230::DEBUG::2012-11-29 15:06:05,978::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.05', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.78', 'elapsedTime': '54', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-232::DEBUG::2012-11-29 15:06:08,046::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-232::DEBUG::2012-11-29 15:06:08,046::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-232::DEBUG::2012-11-29 15:06:08,046::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-232::DEBUG::2012-11-29 15:06:08,046::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-232::DEBUG::2012-11-29 15:06:08,046::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-232::DEBUG::2012-11-29 15:06:08,047::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.05', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.85', 'elapsedTime': '56', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-233::DEBUG::2012-11-29 15:06:10,087::task::568::TaskManager.Task::(_updateState) Task=`505a4594-dff2-4595-a696-6d7ba711b3b7`::moving from state init -> state preparing >Thread-233::INFO::2012-11-29 15:06:10,088::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-233::INFO::2012-11-29 15:06:10,088::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000890016555786', 'lastCheck': '0.7', 'code': 0, 'valid': True}} >Thread-233::DEBUG::2012-11-29 15:06:10,088::task::1151::TaskManager.Task::(prepare) Task=`505a4594-dff2-4595-a696-6d7ba711b3b7`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000890016555786', 'lastCheck': '0.7', 'code': 0, 'valid': True}} >Thread-233::DEBUG::2012-11-29 15:06:10,088::task::568::TaskManager.Task::(_updateState) Task=`505a4594-dff2-4595-a696-6d7ba711b3b7`::moving from state preparing -> state finished >Thread-233::DEBUG::2012-11-29 15:06:10,088::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-233::DEBUG::2012-11-29 15:06:10,088::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-233::DEBUG::2012-11-29 15:06:10,089::task::957::TaskManager.Task::(_decref) Task=`505a4594-dff2-4595-a696-6d7ba711b3b7`::ref 0 aborting False >Thread-234::DEBUG::2012-11-29 15:06:10,120::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-234::DEBUG::2012-11-29 15:06:10,121::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-234::DEBUG::2012-11-29 15:06:10,121::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-234::DEBUG::2012-11-29 15:06:10,121::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-164::DEBUG::2012-11-29 15:06:12,195::task::568::TaskManager.Task::(_updateState) Task=`3b3b7530-fe19-4c93-aa62-5f198bf69743`::moving from state init -> state preparing >Thread-164::INFO::2012-11-29 15:06:12,195::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2', options=None) >Thread-164::DEBUG::2012-11-29 15:06:12,197::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-164::INFO::2012-11-29 15:06:12,199::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '139264', 'apparentsize': '262144'} >Thread-164::DEBUG::2012-11-29 15:06:12,199::task::1151::TaskManager.Task::(prepare) Task=`3b3b7530-fe19-4c93-aa62-5f198bf69743`::finished: {'truesize': '139264', 'apparentsize': '262144'} >Thread-164::DEBUG::2012-11-29 15:06:12,199::task::568::TaskManager.Task::(_updateState) Task=`3b3b7530-fe19-4c93-aa62-5f198bf69743`::moving from state preparing -> state finished >Thread-164::DEBUG::2012-11-29 15:06:12,199::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-164::DEBUG::2012-11-29 15:06:12,199::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-164::DEBUG::2012-11-29 15:06:12,199::task::957::TaskManager.Task::(_decref) Task=`3b3b7530-fe19-4c93-aa62-5f198bf69743`::ref 0 aborting False >Thread-236::DEBUG::2012-11-29 15:06:12,208::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-236::DEBUG::2012-11-29 15:06:12,208::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-236::DEBUG::2012-11-29 15:06:12,209::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-236::DEBUG::2012-11-29 15:06:12,209::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-236::DEBUG::2012-11-29 15:06:12,209::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-236::DEBUG::2012-11-29 15:06:12,209::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '3909', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.13', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.01', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2012-11-29 15:06:12,284::vmChannels::60::vds::(_handle_timeouts) Timeout on fileno 30. >Thread-237::DEBUG::2012-11-29 15:06:13,696::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-237::DEBUG::2012-11-29 15:06:13,696::task::568::TaskManager.Task::(_updateState) Task=`e02f9a6e-1fd6-463f-9a1c-66a52659acb8`::moving from state init -> state preparing >Thread-237::INFO::2012-11-29 15:06:13,697::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-237::INFO::2012-11-29 15:06:13,697::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-237::DEBUG::2012-11-29 15:06:13,697::task::1151::TaskManager.Task::(prepare) Task=`e02f9a6e-1fd6-463f-9a1c-66a52659acb8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-237::DEBUG::2012-11-29 15:06:13,697::task::568::TaskManager.Task::(_updateState) Task=`e02f9a6e-1fd6-463f-9a1c-66a52659acb8`::moving from state preparing -> state finished >Thread-237::DEBUG::2012-11-29 15:06:13,697::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-237::DEBUG::2012-11-29 15:06:13,697::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-237::DEBUG::2012-11-29 15:06:13,698::task::957::TaskManager.Task::(_decref) Task=`e02f9a6e-1fd6-463f-9a1c-66a52659acb8`::ref 0 aborting False >Thread-238::DEBUG::2012-11-29 15:06:13,725::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-238::DEBUG::2012-11-29 15:06:13,726::task::568::TaskManager.Task::(_updateState) Task=`9f2880d7-b55c-4c7a-a310-ef8054017175`::moving from state init -> state preparing >Thread-238::INFO::2012-11-29 15:06:13,726::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-238::DEBUG::2012-11-29 15:06:13,726::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`1a9e9855-d326-4bfb-9af2-9da3d2ff8945`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-238::DEBUG::2012-11-29 15:06:13,726::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-238::DEBUG::2012-11-29 15:06:13,727::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-238::DEBUG::2012-11-29 15:06:13,727::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`1a9e9855-d326-4bfb-9af2-9da3d2ff8945`::Granted request >Thread-238::DEBUG::2012-11-29 15:06:13,727::task::794::TaskManager.Task::(resourceAcquired) Task=`9f2880d7-b55c-4c7a-a310-ef8054017175`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-238::DEBUG::2012-11-29 15:06:13,727::task::957::TaskManager.Task::(_decref) Task=`9f2880d7-b55c-4c7a-a310-ef8054017175`::ref 1 aborting False >Thread-238::INFO::2012-11-29 15:06:13,728::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335278592', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-238::DEBUG::2012-11-29 15:06:13,728::task::1151::TaskManager.Task::(prepare) Task=`9f2880d7-b55c-4c7a-a310-ef8054017175`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335278592', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-238::DEBUG::2012-11-29 15:06:13,728::task::568::TaskManager.Task::(_updateState) Task=`9f2880d7-b55c-4c7a-a310-ef8054017175`::moving from state preparing -> state finished >Thread-238::DEBUG::2012-11-29 15:06:13,729::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-238::DEBUG::2012-11-29 15:06:13,729::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-238::DEBUG::2012-11-29 15:06:13,729::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-238::DEBUG::2012-11-29 15:06:13,729::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-238::DEBUG::2012-11-29 15:06:13,729::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-238::DEBUG::2012-11-29 15:06:13,729::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-238::DEBUG::2012-11-29 15:06:13,730::task::957::TaskManager.Task::(_decref) Task=`9f2880d7-b55c-4c7a-a310-ef8054017175`::ref 0 aborting False >Thread-240::DEBUG::2012-11-29 15:06:15,133::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-240::DEBUG::2012-11-29 15:06:15,134::task::568::TaskManager.Task::(_updateState) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::moving from state init -> state preparing >Thread-240::INFO::2012-11-29 15:06:15,134::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', size='1350565888', volFormat=5, preallocate=2, diskType=2, volUUID='63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-240::INFO::2012-11-29 15:06:15,134::fileSD::302::Storage.StorageDomain::(validate) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-240::DEBUG::2012-11-29 15:06:15,136::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=e459136b318686b029466b3ded781bd95ae1ee44'] >Thread-240::DEBUG::2012-11-29 15:06:15,136::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`5f193ff3-a01d-4f1b-9edf-1db77592dbad`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-240::DEBUG::2012-11-29 15:06:15,137::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-240::DEBUG::2012-11-29 15:06:15,137::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-240::DEBUG::2012-11-29 15:06:15,137::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`5f193ff3-a01d-4f1b-9edf-1db77592dbad`::Granted request >Thread-240::DEBUG::2012-11-29 15:06:15,137::task::794::TaskManager.Task::(resourceAcquired) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-240::DEBUG::2012-11-29 15:06:15,137::task::957::TaskManager.Task::(_decref) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::ref 1 aborting False >Thread-240::DEBUG::2012-11-29 15:06:15,138::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >Thread-240::DEBUG::2012-11-29 15:06:15,167::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 7a4bf03d-a28e-47ab-bd72-599a52616647 >Thread-240::INFO::2012-11-29 15:06:15,167::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-240::DEBUG::2012-11-29 15:06:15,168::task::1146::TaskManager.Task::(prepare) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::Prepare: 1 jobs exist, move to acquiring >Thread-240::DEBUG::2012-11-29 15:06:15,168::task::568::TaskManager.Task::(_updateState) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::moving from state preparing -> state acquiring >Thread-240::DEBUG::2012-11-29 15:06:15,168::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >Thread-240::DEBUG::2012-11-29 15:06:15,184::task::568::TaskManager.Task::(_updateState) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::moving from state acquiring -> state queued >Thread-240::DEBUG::2012-11-29 15:06:15,185::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >Thread-240::DEBUG::2012-11-29 15:06:15,201::taskManager::50::TaskManager::(_queueTask) queuing task: 7a4bf03d-a28e-47ab-bd72-599a52616647 >Thread-240::DEBUG::2012-11-29 15:06:15,201::taskManager::56::TaskManager::(_queueTask) task queued: 7a4bf03d-a28e-47ab-bd72-599a52616647 >4fb52d6f-7a14-4a22-b214-d55e07bcf7ad::DEBUG::2012-11-29 15:06:15,202::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-240::DEBUG::2012-11-29 15:06:15,202::task::1148::TaskManager.Task::(prepare) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::returning >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,202::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 7a4bf03d-a28e-47ab-bd72-599a52616647 running: <bound method Task.commit of <storage.task.Task instance at 0x7fc0fc37f7a0>> with: None >Thread-240::DEBUG::2012-11-29 15:06:15,202::task::957::TaskManager.Task::(_decref) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::ref 0 aborting False >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,203::task::1159::TaskManager.Task::(commit) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::committing task: 7a4bf03d-a28e-47ab-bd72-599a52616647 >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,203::task::568::TaskManager.Task::(_updateState) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::moving from state queued -> state running >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,204::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,218::task::872::TaskManager.Task::(_runJobs) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fc0fc25a790>> (args: ('4d25f33e-850f-4088-8f0b-e9cbc8276313', 'e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', 2637824, 5, 2, 2, '63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,219::task::304::TaskManager.Task::(run) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fc0fc25a790>> (args: ('4d25f33e-850f-4088-8f0b-e9cbc8276313', 'e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', 2637824, 5, 2, 2, '63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,219::resourceManager::175::ResourceManager.Request::(__init__) ResName=`4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a`ReqID=`6600cc8b-e4f9-4990-b9e3-7284f9895f17`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,219::resourceManager::486::ResourceManager::(registerResource) Trying to register resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' for lock type 'exclusive' >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,220::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a does not exist in domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,220::resourceManager::528::ResourceManager::(registerResource) Resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' is free. Now locking as 'exclusive' (1 active user) >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,220::resourceManager::212::ResourceManager.Request::(grant) ResName=`4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a`ReqID=`6600cc8b-e4f9-4990-b9e3-7284f9895f17`::Granted request >7a4bf03d-a28e-47ab-bd72-599a52616647::INFO::2012-11-29 15:06:15,221::image::119::Storage.Image::(create) Create placeholder /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a for image's volumes >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,221::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >7a4bf03d-a28e-47ab-bd72-599a52616647::INFO::2012-11-29 15:06:15,244::volume::457::Storage.Volume::(create) Creating volume 63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070 >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,245::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >Thread-241::DEBUG::2012-11-29 15:06:15,253::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-241::DEBUG::2012-11-29 15:06:15,254::task::568::TaskManager.Task::(_updateState) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::moving from state init -> state preparing >Thread-241::INFO::2012-11-29 15:06:15,254::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='a5f85b97-bab4-4af0-9678-d733ce78f102', size='10240', volFormat=4, preallocate=2, diskType=2, volUUID='286f38b8-b60d-4d20-be4e-c94421b8081a', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-241::INFO::2012-11-29 15:06:15,254::fileSD::302::Storage.StorageDomain::(validate) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-241::DEBUG::2012-11-29 15:06:15,261::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=e459136b318686b029466b3ded781bd95ae1ee44'] >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,262::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >Thread-241::DEBUG::2012-11-29 15:06:15,262::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`00b83e1e-683b-47d5-8c79-6da188d1036d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-241::DEBUG::2012-11-29 15:06:15,263::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-241::DEBUG::2012-11-29 15:06:15,263::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-241::DEBUG::2012-11-29 15:06:15,264::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`00b83e1e-683b-47d5-8c79-6da188d1036d`::Granted request >Thread-241::DEBUG::2012-11-29 15:06:15,265::task::794::TaskManager.Task::(resourceAcquired) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-241::DEBUG::2012-11-29 15:06:15,265::task::957::TaskManager.Task::(_decref) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::ref 1 aborting False >7a4bf03d-a28e-47ab-bd72-599a52616647::INFO::2012-11-29 15:06:15,287::fileVolume::153::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a/63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070 with size = 2637824 sectors >Thread-241::DEBUG::2012-11-29 15:06:15,330::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >Thread-241::DEBUG::2012-11-29 15:06:15,345::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task f4f8833f-96c5-41b1-85ad-5c8806d9cc7e >Thread-241::INFO::2012-11-29 15:06:15,345::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-241::DEBUG::2012-11-29 15:06:15,345::task::1146::TaskManager.Task::(prepare) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::Prepare: 1 jobs exist, move to acquiring >Thread-241::DEBUG::2012-11-29 15:06:15,345::task::568::TaskManager.Task::(_updateState) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::moving from state preparing -> state acquiring >Thread-241::DEBUG::2012-11-29 15:06:15,346::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,352::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >Thread-241::DEBUG::2012-11-29 15:06:15,362::task::568::TaskManager.Task::(_updateState) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::moving from state acquiring -> state queued >Thread-241::DEBUG::2012-11-29 15:06:15,362::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >Thread-241::DEBUG::2012-11-29 15:06:15,387::taskManager::50::TaskManager::(_queueTask) queuing task: f4f8833f-96c5-41b1-85ad-5c8806d9cc7e >Thread-241::DEBUG::2012-11-29 15:06:15,388::taskManager::56::TaskManager::(_queueTask) task queued: f4f8833f-96c5-41b1-85ad-5c8806d9cc7e >Thread-241::DEBUG::2012-11-29 15:06:15,388::task::1148::TaskManager.Task::(prepare) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::returning >Thread-1::DEBUG::2012-11-29 15:06:15,388::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 2 >Thread-241::DEBUG::2012-11-29 15:06:15,389::task::957::TaskManager.Task::(_decref) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::ref 0 aborting False >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,389::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: f4f8833f-96c5-41b1-85ad-5c8806d9cc7e running: <bound method Task.commit of <storage.task.Task instance at 0x7fc0fc61dbd8>> with: None >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,390::task::1159::TaskManager.Task::(commit) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::committing task: f4f8833f-96c5-41b1-85ad-5c8806d9cc7e >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,391::task::568::TaskManager.Task::(_updateState) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::moving from state queued -> state running >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,390::fileVolume::401::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070 sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313, metaId=('/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a/63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070',) >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,391::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,419::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,429::task::872::TaskManager.Task::(_runJobs) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fc0fc25a790>> (args: ('4d25f33e-850f-4088-8f0b-e9cbc8276313', 'a5f85b97-bab4-4af0-9678-d733ce78f102', 20, 4, 2, 2, '286f38b8-b60d-4d20-be4e-c94421b8081a', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,430::task::304::TaskManager.Task::(run) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fc0fc25a790>> (args: ('4d25f33e-850f-4088-8f0b-e9cbc8276313', 'a5f85b97-bab4-4af0-9678-d733ce78f102', 20, 4, 2, 2, '286f38b8-b60d-4d20-be4e-c94421b8081a', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,430::resourceManager::175::ResourceManager.Request::(__init__) ResName=`4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.a5f85b97-bab4-4af0-9678-d733ce78f102`ReqID=`e9eb1dfb-331d-4f13-8713-91b2050a9b1a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,430::resourceManager::486::ResourceManager::(registerResource) Trying to register resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.a5f85b97-bab4-4af0-9678-d733ce78f102' for lock type 'exclusive' >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,431::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image a5f85b97-bab4-4af0-9678-d733ce78f102 does not exist in domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,431::resourceManager::528::ResourceManager::(registerResource) Resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.a5f85b97-bab4-4af0-9678-d733ce78f102' is free. Now locking as 'exclusive' (1 active user) >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,431::resourceManager::212::ResourceManager.Request::(grant) ResName=`4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.a5f85b97-bab4-4af0-9678-d733ce78f102`ReqID=`e9eb1dfb-331d-4f13-8713-91b2050a9b1a`::Granted request >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::INFO::2012-11-29 15:06:15,432::image::119::Storage.Image::(create) Create placeholder /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102 for image's volumes >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,432::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,447::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,447::resourceManager::553::ResourceManager::(releaseResource) Released resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' (0 active users) >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,447::resourceManager::558::ResourceManager::(releaseResource) Resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' is free, finding out if anyone is waiting for it. >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,447::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', Clearing records. >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,447::task::568::TaskManager.Task::(_updateState) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::moving from state running -> state finished >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,448::task::719::TaskManager.Task::(_save) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/7a4bf03d-a28e-47ab-bd72-599a52616647.temp >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::INFO::2012-11-29 15:06:15,548::volume::457::Storage.Volume::(create) Creating volume 286f38b8-b60d-4d20-be4e-c94421b8081a >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,548::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,564::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,564::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,565::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-242::DEBUG::2012-11-29 15:06:15,565::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,566::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (1 active users) >Thread-242::DEBUG::2012-11-29 15:06:15,566::task::568::TaskManager.Task::(_updateState) Task=`fe0de162-776a-41c8-bf3b-29f1229998aa`::moving from state init -> state preparing >Thread-242::INFO::2012-11-29 15:06:15,567::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,567::task::880::TaskManager.Task::(_runJobs) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::Task.run: exit - success: result {'uuid': '63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070'} >Thread-242::DEBUG::2012-11-29 15:06:15,567::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,567::task::957::TaskManager.Task::(_decref) Task=`7a4bf03d-a28e-47ab-bd72-599a52616647`::ref 0 aborting False >Thread-242::DEBUG::2012-11-29 15:06:15,567::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 7a4bf03d-a28e-47ab-bd72-599a52616647 >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:06:15,568::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-242::DEBUG::2012-11-29 15:06:15,568::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a4bf03d-a28e-47ab-bd72-599a52616647'} >Thread-242::DEBUG::2012-11-29 15:06:15,568::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f4f8833f-96c5-41b1-85ad-5c8806d9cc7e >Thread-242::DEBUG::2012-11-29 15:06:15,568::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e'} >Thread-242::DEBUG::2012-11-29 15:06:15,569::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'7a4bf03d-a28e-47ab-bd72-599a52616647': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a4bf03d-a28e-47ab-bd72-599a52616647'}, 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e'}} >Thread-242::INFO::2012-11-29 15:06:15,569::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7a4bf03d-a28e-47ab-bd72-599a52616647': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a4bf03d-a28e-47ab-bd72-599a52616647'}, 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e'}}} >Thread-242::DEBUG::2012-11-29 15:06:15,569::task::1151::TaskManager.Task::(prepare) Task=`fe0de162-776a-41c8-bf3b-29f1229998aa`::finished: {'allTasksStatus': {'7a4bf03d-a28e-47ab-bd72-599a52616647': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a4bf03d-a28e-47ab-bd72-599a52616647'}, 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e'}}} >Thread-242::DEBUG::2012-11-29 15:06:15,569::task::568::TaskManager.Task::(_updateState) Task=`fe0de162-776a-41c8-bf3b-29f1229998aa`::moving from state preparing -> state finished >Thread-242::DEBUG::2012-11-29 15:06:15,569::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-242::DEBUG::2012-11-29 15:06:15,569::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-242::DEBUG::2012-11-29 15:06:15,570::task::957::TaskManager.Task::(_decref) Task=`fe0de162-776a-41c8-bf3b-29f1229998aa`::ref 0 aborting False >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,582::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::INFO::2012-11-29 15:06:15,599::fileVolume::153::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102/286f38b8-b60d-4d20-be4e-c94421b8081a with size = 20 sectors >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,599::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102/286f38b8-b60d-4d20-be4e-c94421b8081a 10K' (cwd None) >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,604::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,667::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,692::fileVolume::401::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=286f38b8-b60d-4d20-be4e-c94421b8081a sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313, metaId=('/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102/286f38b8-b60d-4d20-be4e-c94421b8081a',) >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,734::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,751::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.a5f85b97-bab4-4af0-9678-d733ce78f102' >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,751::resourceManager::553::ResourceManager::(releaseResource) Released resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.a5f85b97-bab4-4af0-9678-d733ce78f102' (0 active users) >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,751::resourceManager::558::ResourceManager::(releaseResource) Resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.a5f85b97-bab4-4af0-9678-d733ce78f102' is free, finding out if anyone is waiting for it. >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,751::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource '4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS.a5f85b97-bab4-4af0-9678-d733ce78f102', Clearing records. >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,752::task::568::TaskManager.Task::(_updateState) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::moving from state running -> state finished >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,752::task::719::TaskManager.Task::(_save) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/f4f8833f-96c5-41b1-85ad-5c8806d9cc7e.temp >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,776::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,776::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,776::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,777::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,777::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,777::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,777::task::880::TaskManager.Task::(_runJobs) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::Task.run: exit - success: result {'uuid': '286f38b8-b60d-4d20-be4e-c94421b8081a'} >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,778::task::957::TaskManager.Task::(_decref) Task=`f4f8833f-96c5-41b1-85ad-5c8806d9cc7e`::ref 0 aborting False >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:06:15,778::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-245::DEBUG::2012-11-29 15:06:20,366::task::568::TaskManager.Task::(_updateState) Task=`9ffc43bc-eb1a-4390-8208-45e8822201f1`::moving from state init -> state preparing >Thread-245::INFO::2012-11-29 15:06:20,367::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-245::INFO::2012-11-29 15:06:20,367::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000890016555786', 'lastCheck': '1.0', 'code': 0, 'valid': True}} >Thread-245::DEBUG::2012-11-29 15:06:20,367::task::1151::TaskManager.Task::(prepare) Task=`9ffc43bc-eb1a-4390-8208-45e8822201f1`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000890016555786', 'lastCheck': '1.0', 'code': 0, 'valid': True}} >Thread-245::DEBUG::2012-11-29 15:06:20,367::task::568::TaskManager.Task::(_updateState) Task=`9ffc43bc-eb1a-4390-8208-45e8822201f1`::moving from state preparing -> state finished >Thread-245::DEBUG::2012-11-29 15:06:20,367::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-245::DEBUG::2012-11-29 15:06:20,368::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-245::DEBUG::2012-11-29 15:06:20,368::task::957::TaskManager.Task::(_decref) Task=`9ffc43bc-eb1a-4390-8208-45e8822201f1`::ref 0 aborting False >Thread-248::DEBUG::2012-11-29 15:06:23,771::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-248::DEBUG::2012-11-29 15:06:23,772::task::568::TaskManager.Task::(_updateState) Task=`d4908fca-a0b1-4001-8c42-e4135ea71e70`::moving from state init -> state preparing >Thread-248::INFO::2012-11-29 15:06:23,772::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-248::INFO::2012-11-29 15:06:23,772::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-248::DEBUG::2012-11-29 15:06:23,772::task::1151::TaskManager.Task::(prepare) Task=`d4908fca-a0b1-4001-8c42-e4135ea71e70`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-248::DEBUG::2012-11-29 15:06:23,773::task::568::TaskManager.Task::(_updateState) Task=`d4908fca-a0b1-4001-8c42-e4135ea71e70`::moving from state preparing -> state finished >Thread-248::DEBUG::2012-11-29 15:06:23,773::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-248::DEBUG::2012-11-29 15:06:23,773::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-248::DEBUG::2012-11-29 15:06:23,773::task::957::TaskManager.Task::(_decref) Task=`d4908fca-a0b1-4001-8c42-e4135ea71e70`::ref 0 aborting False >Thread-249::DEBUG::2012-11-29 15:06:23,804::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-249::DEBUG::2012-11-29 15:06:23,804::task::568::TaskManager.Task::(_updateState) Task=`f71eab52-92ca-48ee-9d72-57b9e1dd052e`::moving from state init -> state preparing >Thread-249::INFO::2012-11-29 15:06:23,804::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-249::DEBUG::2012-11-29 15:06:23,804::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`660e9ce0-df7d-4141-af01-c4104727d56f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-249::DEBUG::2012-11-29 15:06:23,805::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-249::DEBUG::2012-11-29 15:06:23,805::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-249::DEBUG::2012-11-29 15:06:23,805::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`660e9ce0-df7d-4141-af01-c4104727d56f`::Granted request >Thread-249::DEBUG::2012-11-29 15:06:23,805::task::794::TaskManager.Task::(resourceAcquired) Task=`f71eab52-92ca-48ee-9d72-57b9e1dd052e`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-249::DEBUG::2012-11-29 15:06:23,805::task::957::TaskManager.Task::(_decref) Task=`f71eab52-92ca-48ee-9d72-57b9e1dd052e`::ref 1 aborting False >Thread-249::INFO::2012-11-29 15:06:23,806::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459332845568', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-249::DEBUG::2012-11-29 15:06:23,806::task::1151::TaskManager.Task::(prepare) Task=`f71eab52-92ca-48ee-9d72-57b9e1dd052e`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459332845568', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-249::DEBUG::2012-11-29 15:06:23,807::task::568::TaskManager.Task::(_updateState) Task=`f71eab52-92ca-48ee-9d72-57b9e1dd052e`::moving from state preparing -> state finished >Thread-249::DEBUG::2012-11-29 15:06:23,807::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-249::DEBUG::2012-11-29 15:06:23,807::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-249::DEBUG::2012-11-29 15:06:23,807::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-249::DEBUG::2012-11-29 15:06:23,807::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-249::DEBUG::2012-11-29 15:06:23,807::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-249::DEBUG::2012-11-29 15:06:23,808::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-249::DEBUG::2012-11-29 15:06:23,808::task::957::TaskManager.Task::(_decref) Task=`f71eab52-92ca-48ee-9d72-57b9e1dd052e`::ref 0 aborting False >Thread-251::DEBUG::2012-11-29 15:06:25,607::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-251::DEBUG::2012-11-29 15:06:25,608::task::568::TaskManager.Task::(_updateState) Task=`ab67c81b-d836-4037-b619-a8e3148dd7f3`::moving from state init -> state preparing >Thread-251::INFO::2012-11-29 15:06:25,608::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-251::DEBUG::2012-11-29 15:06:25,608::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-251::DEBUG::2012-11-29 15:06:25,608::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 7a4bf03d-a28e-47ab-bd72-599a52616647 >Thread-251::DEBUG::2012-11-29 15:06:25,609::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a4bf03d-a28e-47ab-bd72-599a52616647'} >Thread-251::DEBUG::2012-11-29 15:06:25,609::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f4f8833f-96c5-41b1-85ad-5c8806d9cc7e >Thread-251::DEBUG::2012-11-29 15:06:25,609::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e'} >Thread-251::DEBUG::2012-11-29 15:06:25,609::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'7a4bf03d-a28e-47ab-bd72-599a52616647': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a4bf03d-a28e-47ab-bd72-599a52616647'}, 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e'}} >Thread-251::INFO::2012-11-29 15:06:25,609::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7a4bf03d-a28e-47ab-bd72-599a52616647': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a4bf03d-a28e-47ab-bd72-599a52616647'}, 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e'}}} >Thread-251::DEBUG::2012-11-29 15:06:25,609::task::1151::TaskManager.Task::(prepare) Task=`ab67c81b-d836-4037-b619-a8e3148dd7f3`::finished: {'allTasksStatus': {'7a4bf03d-a28e-47ab-bd72-599a52616647': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7a4bf03d-a28e-47ab-bd72-599a52616647'}, 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f4f8833f-96c5-41b1-85ad-5c8806d9cc7e'}}} >Thread-251::DEBUG::2012-11-29 15:06:25,610::task::568::TaskManager.Task::(_updateState) Task=`ab67c81b-d836-4037-b619-a8e3148dd7f3`::moving from state preparing -> state finished >Thread-251::DEBUG::2012-11-29 15:06:25,610::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251::DEBUG::2012-11-29 15:06:25,610::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251::DEBUG::2012-11-29 15:06:25,610::task::957::TaskManager.Task::(_decref) Task=`ab67c81b-d836-4037-b619-a8e3148dd7f3`::ref 0 aborting False >Thread-252::DEBUG::2012-11-29 15:06:25,666::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmHibernate with ('302eb6e8-593b-42dc-acef-b27ca1440fa8', '4d25f33e-850f-4088-8f0b-e9cbc8276313,b39553bd-b94c-42e1-8e06-40483d5f3c3f,e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a,63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070,a5f85b97-bab4-4af0-9678-d733ce78f102,286f38b8-b60d-4d20-be4e-c94421b8081a') {} flowID [205] >Thread-252::DEBUG::2012-11-29 15:06:25,666::API::432::vds::(migrate) {'hiberVolHandle': '4d25f33e-850f-4088-8f0b-e9cbc8276313,b39553bd-b94c-42e1-8e06-40483d5f3c3f,e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a,63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070,a5f85b97-bab4-4af0-9678-d733ce78f102,286f38b8-b60d-4d20-be4e-c94421b8081a', 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'mode': 'file'} >Thread-252::DEBUG::2012-11-29 15:06:25,667::BindingXMLRPC::910::vds::(wrapper) return vmHibernate with {'status': {'message': 'Hibernation process starting', 'code': 0}} >Thread-253::DEBUG::2012-11-29 15:06:25,670::vm::170::vm.Vm::(_prepareGuest) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Save State begins >Thread-253::DEBUG::2012-11-29 15:06:25,670::guestIF::217::vm.Vm::(desktopLock) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::desktopLock called >libvirtEventLoop::DEBUG::2012-11-29 15:06:25,710::libvirtvm::2765::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::event Suspended detail 0 opaque None >Thread-254::DEBUG::2012-11-29 15:06:25,717::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-254::DEBUG::2012-11-29 15:06:25,718::task::568::TaskManager.Task::(_updateState) Task=`5bf503b5-411c-4a4b-8bb6-7182c3132ba3`::moving from state init -> state preparing >Thread-254::INFO::2012-11-29 15:06:25,718::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='f4f8833f-96c5-41b1-85ad-5c8806d9cc7e', spUUID=None, options=None) >Thread-254::DEBUG::2012-11-29 15:06:25,718::taskManager::161::TaskManager::(clearTask) Entry. taskID: f4f8833f-96c5-41b1-85ad-5c8806d9cc7e >Thread-254::DEBUG::2012-11-29 15:06:25,719::taskManager::166::TaskManager::(clearTask) Return. >Thread-254::INFO::2012-11-29 15:06:25,719::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-254::DEBUG::2012-11-29 15:06:25,719::task::1151::TaskManager.Task::(prepare) Task=`5bf503b5-411c-4a4b-8bb6-7182c3132ba3`::finished: None >Thread-254::DEBUG::2012-11-29 15:06:25,719::task::568::TaskManager.Task::(_updateState) Task=`5bf503b5-411c-4a4b-8bb6-7182c3132ba3`::moving from state preparing -> state finished >Thread-254::DEBUG::2012-11-29 15:06:25,720::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-254::DEBUG::2012-11-29 15:06:25,720::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-254::DEBUG::2012-11-29 15:06:25,720::task::957::TaskManager.Task::(_decref) Task=`5bf503b5-411c-4a4b-8bb6-7182c3132ba3`::ref 0 aborting False >libvirtEventLoop::DEBUG::2012-11-29 15:06:25,745::libvirtvm::2765::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::event Suspended detail 0 opaque None >Thread-253::DEBUG::2012-11-29 15:06:25,745::vm::260::vm.Vm::(run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::migration semaphore acquired >Thread-255::DEBUG::2012-11-29 15:06:25,749::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-255::DEBUG::2012-11-29 15:06:25,751::task::568::TaskManager.Task::(_updateState) Task=`1d65d01a-24b9-48b5-b7c0-9f4cb981d099`::moving from state init -> state preparing >Thread-255::INFO::2012-11-29 15:06:25,753::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='7a4bf03d-a28e-47ab-bd72-599a52616647', spUUID=None, options=None) >Thread-255::DEBUG::2012-11-29 15:06:25,760::taskManager::161::TaskManager::(clearTask) Entry. taskID: 7a4bf03d-a28e-47ab-bd72-599a52616647 >Thread-255::DEBUG::2012-11-29 15:06:25,761::taskManager::166::TaskManager::(clearTask) Return. >Thread-255::INFO::2012-11-29 15:06:25,761::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-255::DEBUG::2012-11-29 15:06:25,762::task::1151::TaskManager.Task::(prepare) Task=`1d65d01a-24b9-48b5-b7c0-9f4cb981d099`::finished: None >Thread-255::DEBUG::2012-11-29 15:06:25,762::task::568::TaskManager.Task::(_updateState) Task=`1d65d01a-24b9-48b5-b7c0-9f4cb981d099`::moving from state preparing -> state finished >Thread-255::DEBUG::2012-11-29 15:06:25,762::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-255::DEBUG::2012-11-29 15:06:25,762::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-255::DEBUG::2012-11-29 15:06:25,763::task::957::TaskManager.Task::(_decref) Task=`1d65d01a-24b9-48b5-b7c0-9f4cb981d099`::ref 0 aborting False >Thread-253::DEBUG::2012-11-29 15:06:25,772::utils::361::vm.Vm::(pause) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Pause statistics collection >Thread-253::DEBUG::2012-11-29 15:06:25,772::task::568::TaskManager.Task::(_updateState) Task=`d9eae61b-029a-4822-8068-bb7ad645c811`::moving from state init -> state preparing >Thread-253::INFO::2012-11-29 15:06:25,773::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', volUUID='63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070') >Thread-253::DEBUG::2012-11-29 15:06:25,773::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`67b1500a-1fc1-4036-90e1-bdb67e9ec62e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-253::DEBUG::2012-11-29 15:06:25,773::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-253::DEBUG::2012-11-29 15:06:25,773::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-253::DEBUG::2012-11-29 15:06:25,773::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`67b1500a-1fc1-4036-90e1-bdb67e9ec62e`::Granted request >Thread-253::DEBUG::2012-11-29 15:06:25,774::task::794::TaskManager.Task::(resourceAcquired) Task=`d9eae61b-029a-4822-8068-bb7ad645c811`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-253::DEBUG::2012-11-29 15:06:25,774::task::957::TaskManager.Task::(_decref) Task=`d9eae61b-029a-4822-8068-bb7ad645c811`::ref 1 aborting False >Thread-253::DEBUG::2012-11-29 15:06:25,775::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070 >Thread-253::INFO::2012-11-29 15:06:25,777::image::344::Storage.Image::(getChain) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 imgUUID=e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a chain=[<storage.fileVolume.FileVolume object at 0x7fc0fc367d10>] >Thread-253::INFO::2012-11-29 15:06:25,778::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a/63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', 'chain': [{'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a/63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'volumeID': '63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', 'imageID': 'e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a'}]} >Thread-253::DEBUG::2012-11-29 15:06:25,778::task::1151::TaskManager.Task::(prepare) Task=`d9eae61b-029a-4822-8068-bb7ad645c811`::finished: {'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a/63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', 'chain': [{'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a/63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'volumeID': '63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070', 'imageID': 'e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a'}]} >Thread-253::DEBUG::2012-11-29 15:06:25,779::task::568::TaskManager.Task::(_updateState) Task=`d9eae61b-029a-4822-8068-bb7ad645c811`::moving from state preparing -> state finished >Thread-253::DEBUG::2012-11-29 15:06:25,779::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-253::DEBUG::2012-11-29 15:06:25,779::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-253::DEBUG::2012-11-29 15:06:25,779::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-253::DEBUG::2012-11-29 15:06:25,779::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-253::DEBUG::2012-11-29 15:06:25,779::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-253::DEBUG::2012-11-29 15:06:25,780::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-253::DEBUG::2012-11-29 15:06:25,780::task::957::TaskManager.Task::(_decref) Task=`d9eae61b-029a-4822-8068-bb7ad645c811`::ref 0 aborting False >Thread-253::INFO::2012-11-29 15:06:25,780::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a/63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070 >Thread-253::DEBUG::2012-11-29 15:06:27,250::task::568::TaskManager.Task::(_updateState) Task=`3c5fe1f5-6d8f-44c0-858d-a160d3edf5f3`::moving from state init -> state preparing >Thread-253::INFO::2012-11-29 15:06:27,250::logUtils::37::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', volUUID=None) >libvirtEventLoop::DEBUG::2012-11-29 15:06:27,250::libvirtvm::2765::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::event Stopped detail 4 opaque None >Thread-253::DEBUG::2012-11-29 15:06:27,251::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`6d864045-c83d-454b-9aee-7d398aae8c24`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-253::DEBUG::2012-11-29 15:06:27,251::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-253::DEBUG::2012-11-29 15:06:27,252::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-253::DEBUG::2012-11-29 15:06:27,252::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`6d864045-c83d-454b-9aee-7d398aae8c24`::Granted request >Thread-253::DEBUG::2012-11-29 15:06:27,253::task::794::TaskManager.Task::(resourceAcquired) Task=`3c5fe1f5-6d8f-44c0-858d-a160d3edf5f3`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-253::DEBUG::2012-11-29 15:06:27,253::task::957::TaskManager.Task::(_decref) Task=`3c5fe1f5-6d8f-44c0-858d-a160d3edf5f3`::ref 1 aborting False >Thread-253::DEBUG::2012-11-29 15:06:27,254::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070 >Thread-253::DEBUG::2012-11-29 15:06:27,267::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070 >Thread-253::DEBUG::2012-11-29 15:06:27,269::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 63fbb6c7-c130-40f8-b4b5-4e6b3ae7b070 >Thread-253::INFO::2012-11-29 15:06:27,272::image::344::Storage.Image::(getChain) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 imgUUID=e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a chain=[<storage.fileVolume.FileVolume object at 0x7fc0fc367310>] >Thread-253::INFO::2012-11-29 15:06:27,272::logUtils::39::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-253::DEBUG::2012-11-29 15:06:27,272::task::1151::TaskManager.Task::(prepare) Task=`3c5fe1f5-6d8f-44c0-858d-a160d3edf5f3`::finished: None >Thread-253::DEBUG::2012-11-29 15:06:27,272::task::568::TaskManager.Task::(_updateState) Task=`3c5fe1f5-6d8f-44c0-858d-a160d3edf5f3`::moving from state preparing -> state finished >Thread-253::DEBUG::2012-11-29 15:06:27,273::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-253::DEBUG::2012-11-29 15:06:27,273::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-253::DEBUG::2012-11-29 15:06:27,273::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-253::DEBUG::2012-11-29 15:06:27,273::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-253::DEBUG::2012-11-29 15:06:27,274::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-253::DEBUG::2012-11-29 15:06:27,274::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-253::DEBUG::2012-11-29 15:06:27,274::task::957::TaskManager.Task::(_decref) Task=`3c5fe1f5-6d8f-44c0-858d-a160d3edf5f3`::ref 0 aborting False >Thread-253::DEBUG::2012-11-29 15:06:27,274::task::568::TaskManager.Task::(_updateState) Task=`5bd8a07f-53c7-4b6a-ba55-7b5ad0cfb594`::moving from state init -> state preparing >Thread-253::INFO::2012-11-29 15:06:27,275::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='a5f85b97-bab4-4af0-9678-d733ce78f102', volUUID='286f38b8-b60d-4d20-be4e-c94421b8081a') >Thread-253::DEBUG::2012-11-29 15:06:27,275::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`d2b19131-c213-4119-93af-04420c2f5d7d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-253::DEBUG::2012-11-29 15:06:27,275::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-253::DEBUG::2012-11-29 15:06:27,276::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-253::DEBUG::2012-11-29 15:06:27,276::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`d2b19131-c213-4119-93af-04420c2f5d7d`::Granted request >Thread-253::DEBUG::2012-11-29 15:06:27,276::task::794::TaskManager.Task::(resourceAcquired) Task=`5bd8a07f-53c7-4b6a-ba55-7b5ad0cfb594`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-253::DEBUG::2012-11-29 15:06:27,277::task::957::TaskManager.Task::(_decref) Task=`5bd8a07f-53c7-4b6a-ba55-7b5ad0cfb594`::ref 1 aborting False >Thread-253::DEBUG::2012-11-29 15:06:27,278::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 286f38b8-b60d-4d20-be4e-c94421b8081a >Thread-253::INFO::2012-11-29 15:06:27,281::image::344::Storage.Image::(getChain) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 imgUUID=a5f85b97-bab4-4af0-9678-d733ce78f102 chain=[<storage.fileVolume.FileVolume object at 0x7fc0fc367d50>] >Thread-253::INFO::2012-11-29 15:06:27,282::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102/286f38b8-b60d-4d20-be4e-c94421b8081a', 'chain': [{'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102/286f38b8-b60d-4d20-be4e-c94421b8081a', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'volumeID': '286f38b8-b60d-4d20-be4e-c94421b8081a', 'imageID': 'a5f85b97-bab4-4af0-9678-d733ce78f102'}]} >Thread-253::DEBUG::2012-11-29 15:06:27,282::task::1151::TaskManager.Task::(prepare) Task=`5bd8a07f-53c7-4b6a-ba55-7b5ad0cfb594`::finished: {'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102/286f38b8-b60d-4d20-be4e-c94421b8081a', 'chain': [{'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102/286f38b8-b60d-4d20-be4e-c94421b8081a', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'volumeID': '286f38b8-b60d-4d20-be4e-c94421b8081a', 'imageID': 'a5f85b97-bab4-4af0-9678-d733ce78f102'}]} >Thread-253::DEBUG::2012-11-29 15:06:27,282::task::568::TaskManager.Task::(_updateState) Task=`5bd8a07f-53c7-4b6a-ba55-7b5ad0cfb594`::moving from state preparing -> state finished >Thread-253::DEBUG::2012-11-29 15:06:27,282::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-253::DEBUG::2012-11-29 15:06:27,282::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-253::DEBUG::2012-11-29 15:06:27,283::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-253::DEBUG::2012-11-29 15:06:27,283::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-253::DEBUG::2012-11-29 15:06:27,283::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-253::DEBUG::2012-11-29 15:06:27,283::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-253::DEBUG::2012-11-29 15:06:27,284::task::957::TaskManager.Task::(_decref) Task=`5bd8a07f-53c7-4b6a-ba55-7b5ad0cfb594`::ref 0 aborting False >Thread-253::INFO::2012-11-29 15:06:27,284::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/a5f85b97-bab4-4af0-9678-d733ce78f102/286f38b8-b60d-4d20-be4e-c94421b8081a >Thread-253::DEBUG::2012-11-29 15:06:27,289::task::568::TaskManager.Task::(_updateState) Task=`4232c282-9d72-4102-999c-ce10a046a1b6`::moving from state init -> state preparing >Thread-253::INFO::2012-11-29 15:06:27,290::logUtils::37::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='a5f85b97-bab4-4af0-9678-d733ce78f102', volUUID=None) >Thread-253::DEBUG::2012-11-29 15:06:27,290::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`767b404e-5dd9-44da-b4c3-69c0f9dd6ec7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-253::DEBUG::2012-11-29 15:06:27,290::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-253::DEBUG::2012-11-29 15:06:27,291::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-253::DEBUG::2012-11-29 15:06:27,291::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`767b404e-5dd9-44da-b4c3-69c0f9dd6ec7`::Granted request >Thread-253::DEBUG::2012-11-29 15:06:27,291::task::794::TaskManager.Task::(resourceAcquired) Task=`4232c282-9d72-4102-999c-ce10a046a1b6`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-253::DEBUG::2012-11-29 15:06:27,292::task::957::TaskManager.Task::(_decref) Task=`4232c282-9d72-4102-999c-ce10a046a1b6`::ref 1 aborting False >Thread-253::DEBUG::2012-11-29 15:06:27,293::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 286f38b8-b60d-4d20-be4e-c94421b8081a >Thread-253::DEBUG::2012-11-29 15:06:27,296::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 286f38b8-b60d-4d20-be4e-c94421b8081a >Thread-253::DEBUG::2012-11-29 15:06:27,299::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 286f38b8-b60d-4d20-be4e-c94421b8081a >Thread-253::INFO::2012-11-29 15:06:27,302::image::344::Storage.Image::(getChain) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 imgUUID=a5f85b97-bab4-4af0-9678-d733ce78f102 chain=[<storage.fileVolume.FileVolume object at 0x7fc0fc367e90>] >Thread-253::INFO::2012-11-29 15:06:27,302::logUtils::39::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-253::DEBUG::2012-11-29 15:06:27,302::task::1151::TaskManager.Task::(prepare) Task=`4232c282-9d72-4102-999c-ce10a046a1b6`::finished: None >Thread-253::DEBUG::2012-11-29 15:06:27,302::task::568::TaskManager.Task::(_updateState) Task=`4232c282-9d72-4102-999c-ce10a046a1b6`::moving from state preparing -> state finished >Thread-253::DEBUG::2012-11-29 15:06:27,303::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-253::DEBUG::2012-11-29 15:06:27,303::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-253::DEBUG::2012-11-29 15:06:27,303::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-253::DEBUG::2012-11-29 15:06:27,304::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-253::DEBUG::2012-11-29 15:06:27,304::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-253::DEBUG::2012-11-29 15:06:27,304::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-253::DEBUG::2012-11-29 15:06:27,304::task::957::TaskManager.Task::(_decref) Task=`4232c282-9d72-4102-999c-ce10a046a1b6`::ref 0 aborting False >Thread-253::DEBUG::2012-11-29 15:06:27,317::vm::1031::vm.Vm::(setDownStatus) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Changed state to Down: SaveState succeeded >Thread-253::DEBUG::2012-11-29 15:06:27,317::vmChannels::152::vds::(unregister) Delete fileno 30 from listener. >Thread-253::DEBUG::2012-11-29 15:06:27,317::utils::353::vm.Vm::(stop) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Stop statistics collection >VM Channels Listener::DEBUG::2012-11-29 15:06:27,318::vmChannels::88::vds::(_do_del_channels) fileno 30 was removed from listener. >Thread-164::DEBUG::2012-11-29 15:06:27,319::utils::384::vm.Vm::(run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Stats thread finished >Thread-258::DEBUG::2012-11-29 15:06:28,585::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-258::DEBUG::2012-11-29 15:06:28,586::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'hash': '609220775704930004', 'exitMessage': 'SaveState succeeded', 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'timeOffset': '0', 'exitCode': 0}]} >Thread-259::DEBUG::2012-11-29 15:06:28,621::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmDestroy with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-259::INFO::2012-11-29 15:06:28,621::API::308::vds::(destroy) vmContainerLock acquired by vm 302eb6e8-593b-42dc-acef-b27ca1440fa8 >Thread-259::DEBUG::2012-11-29 15:06:28,621::libvirtvm::2391::vm.Vm::(destroy) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::destroy Called >Thread-259::INFO::2012-11-29 15:06:28,621::libvirtvm::2340::vm.Vm::(releaseVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Release VM resources >Thread-259::WARNING::2012-11-29 15:06:28,621::vm::375::vm.Vm::(_set_lastStatus) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::trying to set state to Powering down when already Down >Thread-259::DEBUG::2012-11-29 15:06:28,622::utils::353::vm.Vm::(stop) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Stop statistics collection >Thread-259::DEBUG::2012-11-29 15:06:28,622::vmChannels::152::vds::(unregister) Delete fileno 30 from listener. >Thread-259::DEBUG::2012-11-29 15:06:28,623::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) >Thread-259::DEBUG::2012-11-29 15:06:28,654::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-259::DEBUG::2012-11-29 15:06:28,655::vmChannels::152::vds::(unregister) Delete fileno 30 from listener. >Thread-259::DEBUG::2012-11-29 15:06:28,655::task::568::TaskManager.Task::(_updateState) Task=`00042d3a-c05e-4696-9736-95ad86629c15`::moving from state init -> state preparing >Thread-259::INFO::2012-11-29 15:06:28,656::logUtils::37::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='302eb6e8-593b-42dc-acef-b27ca1440fa8') >Thread-259::INFO::2012-11-29 15:06:28,658::logUtils::39::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-259::DEBUG::2012-11-29 15:06:28,659::task::1151::TaskManager.Task::(prepare) Task=`00042d3a-c05e-4696-9736-95ad86629c15`::finished: None >Thread-259::DEBUG::2012-11-29 15:06:28,659::task::568::TaskManager.Task::(_updateState) Task=`00042d3a-c05e-4696-9736-95ad86629c15`::moving from state preparing -> state finished >Thread-259::DEBUG::2012-11-29 15:06:28,659::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-259::DEBUG::2012-11-29 15:06:28,659::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-259::DEBUG::2012-11-29 15:06:28,659::task::957::TaskManager.Task::(_decref) Task=`00042d3a-c05e-4696-9736-95ad86629c15`::ref 0 aborting False >Thread-259::DEBUG::2012-11-29 15:06:28,660::libvirtvm::2385::vm.Vm::(deleteVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Total desktops after destroy of 302eb6e8-593b-42dc-acef-b27ca1440fa8 is 0 >Thread-259::DEBUG::2012-11-29 15:06:28,660::BindingXMLRPC::910::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >VM Channels Listener::DEBUG::2012-11-29 15:06:29,322::vmChannels::88::vds::(_do_del_channels) fileno 30 was removed from listener. >VM Channels Listener::DEBUG::2012-11-29 15:06:29,322::vmChannels::88::vds::(_do_del_channels) fileno 30 was removed from listener. >Thread-260::DEBUG::2012-11-29 15:06:30,730::task::568::TaskManager.Task::(_updateState) Task=`4e42c080-4dc3-4a22-b6b4-84e2ca2cc87d`::moving from state init -> state preparing >Thread-260::INFO::2012-11-29 15:06:30,730::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-260::INFO::2012-11-29 15:06:30,730::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0113840103149', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-260::DEBUG::2012-11-29 15:06:30,730::task::1151::TaskManager.Task::(prepare) Task=`4e42c080-4dc3-4a22-b6b4-84e2ca2cc87d`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0113840103149', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-260::DEBUG::2012-11-29 15:06:30,731::task::568::TaskManager.Task::(_updateState) Task=`4e42c080-4dc3-4a22-b6b4-84e2ca2cc87d`::moving from state preparing -> state finished >Thread-260::DEBUG::2012-11-29 15:06:30,731::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-260::DEBUG::2012-11-29 15:06:30,731::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-260::DEBUG::2012-11-29 15:06:30,731::task::957::TaskManager.Task::(_decref) Task=`4e42c080-4dc3-4a22-b6b4-84e2ca2cc87d`::ref 0 aborting False >Thread-263::DEBUG::2012-11-29 15:06:33,850::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-263::DEBUG::2012-11-29 15:06:33,851::task::568::TaskManager.Task::(_updateState) Task=`25181097-c6ef-4133-b9a5-e33b910cea2d`::moving from state init -> state preparing >Thread-263::INFO::2012-11-29 15:06:33,851::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-263::INFO::2012-11-29 15:06:33,851::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-263::DEBUG::2012-11-29 15:06:33,851::task::1151::TaskManager.Task::(prepare) Task=`25181097-c6ef-4133-b9a5-e33b910cea2d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-263::DEBUG::2012-11-29 15:06:33,851::task::568::TaskManager.Task::(_updateState) Task=`25181097-c6ef-4133-b9a5-e33b910cea2d`::moving from state preparing -> state finished >Thread-263::DEBUG::2012-11-29 15:06:33,852::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-263::DEBUG::2012-11-29 15:06:33,852::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-263::DEBUG::2012-11-29 15:06:33,852::task::957::TaskManager.Task::(_decref) Task=`25181097-c6ef-4133-b9a5-e33b910cea2d`::ref 0 aborting False >Thread-264::DEBUG::2012-11-29 15:06:33,879::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-264::DEBUG::2012-11-29 15:06:33,879::task::568::TaskManager.Task::(_updateState) Task=`051d7b94-a486-4f1a-bd9c-71cd533ff108`::moving from state init -> state preparing >Thread-264::INFO::2012-11-29 15:06:33,879::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-264::DEBUG::2012-11-29 15:06:33,880::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`1d09c15b-7dd9-4fe5-8880-7b93e9fdf1df`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-264::DEBUG::2012-11-29 15:06:33,880::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-264::DEBUG::2012-11-29 15:06:33,880::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-264::DEBUG::2012-11-29 15:06:33,880::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`1d09c15b-7dd9-4fe5-8880-7b93e9fdf1df`::Granted request >Thread-264::DEBUG::2012-11-29 15:06:33,881::task::794::TaskManager.Task::(resourceAcquired) Task=`051d7b94-a486-4f1a-bd9c-71cd533ff108`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-264::DEBUG::2012-11-29 15:06:33,881::task::957::TaskManager.Task::(_decref) Task=`051d7b94-a486-4f1a-bd9c-71cd533ff108`::ref 1 aborting False >Thread-264::INFO::2012-11-29 15:06:33,881::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459331735552', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-264::DEBUG::2012-11-29 15:06:33,882::task::1151::TaskManager.Task::(prepare) Task=`051d7b94-a486-4f1a-bd9c-71cd533ff108`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459331735552', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-264::DEBUG::2012-11-29 15:06:33,882::task::568::TaskManager.Task::(_updateState) Task=`051d7b94-a486-4f1a-bd9c-71cd533ff108`::moving from state preparing -> state finished >Thread-264::DEBUG::2012-11-29 15:06:33,882::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-264::DEBUG::2012-11-29 15:06:33,882::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-264::DEBUG::2012-11-29 15:06:33,882::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-264::DEBUG::2012-11-29 15:06:33,883::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-264::DEBUG::2012-11-29 15:06:33,883::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-264::DEBUG::2012-11-29 15:06:33,883::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-264::DEBUG::2012-11-29 15:06:33,883::task::957::TaskManager.Task::(_decref) Task=`051d7b94-a486-4f1a-bd9c-71cd533ff108`::ref 0 aborting False >Thread-267::DEBUG::2012-11-29 15:06:37,619::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-267::DEBUG::2012-11-29 15:06:37,620::task::568::TaskManager.Task::(_updateState) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::moving from state init -> state preparing >Thread-267::INFO::2012-11-29 15:06:37,620::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', postZero='false', force='false') >Thread-267::INFO::2012-11-29 15:06:37,620::fileSD::302::Storage.StorageDomain::(validate) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-267::DEBUG::2012-11-29 15:06:37,622::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=e459136b318686b029466b3ded781bd95ae1ee44'] >Thread-267::DEBUG::2012-11-29 15:06:37,622::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a`ReqID=`33174909-2603-4862-bec8-284214f57549`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-267::DEBUG::2012-11-29 15:06:37,622::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' for lock type 'exclusive' >Thread-267::DEBUG::2012-11-29 15:06:37,623::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' is free. Now locking as 'exclusive' (1 active user) >Thread-267::DEBUG::2012-11-29 15:06:37,623::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a`ReqID=`33174909-2603-4862-bec8-284214f57549`::Granted request >Thread-267::DEBUG::2012-11-29 15:06:37,623::task::794::TaskManager.Task::(resourceAcquired) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::_resourcesAcquired: Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a (exclusive) >Thread-267::DEBUG::2012-11-29 15:06:37,623::task::957::TaskManager.Task::(_decref) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::ref 1 aborting False >Thread-267::DEBUG::2012-11-29 15:06:37,624::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`9af1d79e-72ff-4521-a4be-7c467239a654`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-267::DEBUG::2012-11-29 15:06:37,624::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-267::DEBUG::2012-11-29 15:06:37,624::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-267::DEBUG::2012-11-29 15:06:37,624::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`9af1d79e-72ff-4521-a4be-7c467239a654`::Granted request >Thread-267::DEBUG::2012-11-29 15:06:37,625::task::794::TaskManager.Task::(resourceAcquired) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-267::DEBUG::2012-11-29 15:06:37,625::task::957::TaskManager.Task::(_decref) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::ref 1 aborting False >Thread-267::DEBUG::2012-11-29 15:06:37,644::task::719::TaskManager.Task::(_save) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c.temp >Thread-267::DEBUG::2012-11-29 15:06:37,676::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a for task 945882a4-532b-4e54-978c-818bf855ea7c >Thread-267::INFO::2012-11-29 15:06:37,676::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-267::DEBUG::2012-11-29 15:06:37,676::task::1146::TaskManager.Task::(prepare) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::Prepare: 1 jobs exist, move to acquiring >Thread-267::DEBUG::2012-11-29 15:06:37,676::task::568::TaskManager.Task::(_updateState) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::moving from state preparing -> state acquiring >Thread-267::DEBUG::2012-11-29 15:06:37,677::task::719::TaskManager.Task::(_save) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c.temp >Thread-267::DEBUG::2012-11-29 15:06:37,693::task::568::TaskManager.Task::(_updateState) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::moving from state acquiring -> state queued >Thread-267::DEBUG::2012-11-29 15:06:37,693::task::719::TaskManager.Task::(_save) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c.temp >Thread-267::DEBUG::2012-11-29 15:06:37,710::taskManager::50::TaskManager::(_queueTask) queuing task: 945882a4-532b-4e54-978c-818bf855ea7c >Thread-267::DEBUG::2012-11-29 15:06:37,710::taskManager::56::TaskManager::(_queueTask) task queued: 945882a4-532b-4e54-978c-818bf855ea7c >Thread-7::DEBUG::2012-11-29 15:06:37,710::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-267::DEBUG::2012-11-29 15:06:37,710::task::1148::TaskManager.Task::(prepare) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::returning >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,710::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 945882a4-532b-4e54-978c-818bf855ea7c running: <bound method Task.commit of <storage.task.Task instance at 0x7fc0fc62b5a8>> with: None >Thread-267::DEBUG::2012-11-29 15:06:37,711::task::957::TaskManager.Task::(_decref) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::ref 0 aborting False >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,711::task::1159::TaskManager.Task::(commit) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::committing task: 945882a4-532b-4e54-978c-818bf855ea7c >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,712::task::568::TaskManager.Task::(_updateState) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::moving from state queued -> state running >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,713::task::719::TaskManager.Task::(_save) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c.temp >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,727::task::872::TaskManager.Task::(_runJobs) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::Task.run: running job 0: deleteImage_e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a: <function <lambda> at 0x7fc0fc269b90> (args: () kwargs: {}) >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,727::task::304::TaskManager.Task::(run) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::Job.run: running deleteImage_e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a: <function <lambda> at 0x7fc0fc269b90> (args: () kwargs: {}) callback None >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,727::task::568::TaskManager.Task::(_updateState) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::moving from state running -> state finished >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,727::task::719::TaskManager.Task::(_save) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/945882a4-532b-4e54-978c-818bf855ea7c.temp >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,744::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>, 'Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a': < ResourceRef 'Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', isValid: 'True' obj: 'None'>} >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,744::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,744::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,744::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,744::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,745::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,745::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,745::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' (0 active users) >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,745::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a' is free, finding out if anyone is waiting for it. >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,745::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e79d3372-cbd7-43d1-b6d5-cd3a3daeb96a', Clearing records. >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,746::task::880::TaskManager.Task::(_runJobs) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::Task.run: exit - success: result True >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,746::task::957::TaskManager.Task::(_decref) Task=`945882a4-532b-4e54-978c-818bf855ea7c`::ref 0 aborting False >945882a4-532b-4e54-978c-818bf855ea7c::DEBUG::2012-11-29 15:06:37,746::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-268::DEBUG::2012-11-29 15:06:37,756::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-268::DEBUG::2012-11-29 15:06:37,756::task::568::TaskManager.Task::(_updateState) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::moving from state init -> state preparing >Thread-268::INFO::2012-11-29 15:06:37,757::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='a5f85b97-bab4-4af0-9678-d733ce78f102', postZero='false', force='false') >Thread-268::INFO::2012-11-29 15:06:37,757::fileSD::302::Storage.StorageDomain::(validate) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-268::DEBUG::2012-11-29 15:06:37,758::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=e459136b318686b029466b3ded781bd95ae1ee44'] >Thread-268::DEBUG::2012-11-29 15:06:37,758::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.a5f85b97-bab4-4af0-9678-d733ce78f102`ReqID=`a1a0e583-cc24-4b64-b731-269e76fbbd83`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-268::DEBUG::2012-11-29 15:06:37,759::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.a5f85b97-bab4-4af0-9678-d733ce78f102' for lock type 'exclusive' >Thread-268::DEBUG::2012-11-29 15:06:37,759::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.a5f85b97-bab4-4af0-9678-d733ce78f102' is free. Now locking as 'exclusive' (1 active user) >Thread-268::DEBUG::2012-11-29 15:06:37,759::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.a5f85b97-bab4-4af0-9678-d733ce78f102`ReqID=`a1a0e583-cc24-4b64-b731-269e76fbbd83`::Granted request >Thread-268::DEBUG::2012-11-29 15:06:37,759::task::794::TaskManager.Task::(resourceAcquired) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::_resourcesAcquired: Storage.a5f85b97-bab4-4af0-9678-d733ce78f102 (exclusive) >Thread-268::DEBUG::2012-11-29 15:06:37,759::task::957::TaskManager.Task::(_decref) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::ref 1 aborting False >Thread-268::DEBUG::2012-11-29 15:06:37,760::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`ac6c4947-c218-4d47-bfbe-05bb254e28e3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-268::DEBUG::2012-11-29 15:06:37,760::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-268::DEBUG::2012-11-29 15:06:37,760::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-268::DEBUG::2012-11-29 15:06:37,760::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`ac6c4947-c218-4d47-bfbe-05bb254e28e3`::Granted request >Thread-268::DEBUG::2012-11-29 15:06:37,761::task::794::TaskManager.Task::(resourceAcquired) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-268::DEBUG::2012-11-29 15:06:37,761::task::957::TaskManager.Task::(_decref) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::ref 1 aborting False >Thread-268::DEBUG::2012-11-29 15:06:37,764::task::719::TaskManager.Task::(_save) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983.temp >Thread-268::DEBUG::2012-11-29 15:06:37,786::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_a5f85b97-bab4-4af0-9678-d733ce78f102 for task 84ac9405-3ae2-442e-b238-8b47704a4983 >Thread-268::INFO::2012-11-29 15:06:37,786::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-268::DEBUG::2012-11-29 15:06:37,786::task::1146::TaskManager.Task::(prepare) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::Prepare: 1 jobs exist, move to acquiring >Thread-268::DEBUG::2012-11-29 15:06:37,786::task::568::TaskManager.Task::(_updateState) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::moving from state preparing -> state acquiring >Thread-268::DEBUG::2012-11-29 15:06:37,787::task::719::TaskManager.Task::(_save) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983.temp >Thread-268::DEBUG::2012-11-29 15:06:37,803::task::568::TaskManager.Task::(_updateState) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::moving from state acquiring -> state queued >Thread-268::DEBUG::2012-11-29 15:06:37,803::task::719::TaskManager.Task::(_save) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983.temp >Thread-268::DEBUG::2012-11-29 15:06:37,820::taskManager::50::TaskManager::(_queueTask) queuing task: 84ac9405-3ae2-442e-b238-8b47704a4983 >Thread-268::DEBUG::2012-11-29 15:06:37,820::taskManager::56::TaskManager::(_queueTask) task queued: 84ac9405-3ae2-442e-b238-8b47704a4983 >Thread-9::DEBUG::2012-11-29 15:06:37,820::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-268::DEBUG::2012-11-29 15:06:37,820::task::1148::TaskManager.Task::(prepare) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::returning >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,821::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 84ac9405-3ae2-442e-b238-8b47704a4983 running: <bound method Task.commit of <storage.task.Task instance at 0x7fc0fc495248>> with: None >Thread-268::DEBUG::2012-11-29 15:06:37,821::task::957::TaskManager.Task::(_decref) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::ref 0 aborting False >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,821::task::1159::TaskManager.Task::(commit) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::committing task: 84ac9405-3ae2-442e-b238-8b47704a4983 >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,822::task::568::TaskManager.Task::(_updateState) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::moving from state queued -> state running >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,823::task::719::TaskManager.Task::(_save) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983.temp >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,845::task::872::TaskManager.Task::(_runJobs) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::Task.run: running job 0: deleteImage_a5f85b97-bab4-4af0-9678-d733ce78f102: <function <lambda> at 0x7fc0fc269c08> (args: () kwargs: {}) >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,845::task::304::TaskManager.Task::(run) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::Job.run: running deleteImage_a5f85b97-bab4-4af0-9678-d733ce78f102: <function <lambda> at 0x7fc0fc269c08> (args: () kwargs: {}) callback None >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,846::task::568::TaskManager.Task::(_updateState) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::moving from state running -> state finished >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,846::task::719::TaskManager.Task::(_save) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983 temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/84ac9405-3ae2-442e-b238-8b47704a4983.temp >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,862::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>, 'Storage.a5f85b97-bab4-4af0-9678-d733ce78f102': < ResourceRef 'Storage.a5f85b97-bab4-4af0-9678-d733ce78f102', isValid: 'True' obj: 'None'>} >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,862::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,863::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,863::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,863::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,863::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,863::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.a5f85b97-bab4-4af0-9678-d733ce78f102' >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,864::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.a5f85b97-bab4-4af0-9678-d733ce78f102' (0 active users) >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,864::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.a5f85b97-bab4-4af0-9678-d733ce78f102' is free, finding out if anyone is waiting for it. >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,864::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a5f85b97-bab4-4af0-9678-d733ce78f102', Clearing records. >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,864::task::880::TaskManager.Task::(_runJobs) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::Task.run: exit - success: result True >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,864::task::957::TaskManager.Task::(_decref) Task=`84ac9405-3ae2-442e-b238-8b47704a4983`::ref 0 aborting False >84ac9405-3ae2-442e-b238-8b47704a4983::DEBUG::2012-11-29 15:06:37,864::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-270::DEBUG::2012-11-29 15:06:40,945::task::568::TaskManager.Task::(_updateState) Task=`b3d37c7a-02e9-4baf-aa6b-4eda9255f448`::moving from state init -> state preparing >Thread-270::INFO::2012-11-29 15:06:40,946::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-270::INFO::2012-11-29 15:06:40,946::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000859975814819', 'lastCheck': '1.6', 'code': 0, 'valid': True}} >Thread-270::DEBUG::2012-11-29 15:06:40,946::task::1151::TaskManager.Task::(prepare) Task=`b3d37c7a-02e9-4baf-aa6b-4eda9255f448`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000859975814819', 'lastCheck': '1.6', 'code': 0, 'valid': True}} >Thread-270::DEBUG::2012-11-29 15:06:40,946::task::568::TaskManager.Task::(_updateState) Task=`b3d37c7a-02e9-4baf-aa6b-4eda9255f448`::moving from state preparing -> state finished >Thread-270::DEBUG::2012-11-29 15:06:40,946::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-270::DEBUG::2012-11-29 15:06:40,946::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-270::DEBUG::2012-11-29 15:06:40,947::task::957::TaskManager.Task::(_decref) Task=`b3d37c7a-02e9-4baf-aa6b-4eda9255f448`::ref 0 aborting False >Thread-273::DEBUG::2012-11-29 15:06:43,924::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-273::DEBUG::2012-11-29 15:06:43,924::task::568::TaskManager.Task::(_updateState) Task=`c2309daf-df26-4ecb-a39a-cee3bd5ceadd`::moving from state init -> state preparing >Thread-273::INFO::2012-11-29 15:06:43,925::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-273::INFO::2012-11-29 15:06:43,925::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-273::DEBUG::2012-11-29 15:06:43,925::task::1151::TaskManager.Task::(prepare) Task=`c2309daf-df26-4ecb-a39a-cee3bd5ceadd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-273::DEBUG::2012-11-29 15:06:43,925::task::568::TaskManager.Task::(_updateState) Task=`c2309daf-df26-4ecb-a39a-cee3bd5ceadd`::moving from state preparing -> state finished >Thread-273::DEBUG::2012-11-29 15:06:43,925::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-273::DEBUG::2012-11-29 15:06:43,926::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-273::DEBUG::2012-11-29 15:06:43,926::task::957::TaskManager.Task::(_decref) Task=`c2309daf-df26-4ecb-a39a-cee3bd5ceadd`::ref 0 aborting False >Thread-274::DEBUG::2012-11-29 15:06:43,954::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-274::DEBUG::2012-11-29 15:06:43,955::task::568::TaskManager.Task::(_updateState) Task=`733f2cb9-4ad3-4c21-bd8b-c6362d5f6acb`::moving from state init -> state preparing >Thread-274::INFO::2012-11-29 15:06:43,955::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-274::DEBUG::2012-11-29 15:06:43,955::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`1e861e24-1ff8-46ac-9644-ff965fa6143d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-274::DEBUG::2012-11-29 15:06:43,955::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-274::DEBUG::2012-11-29 15:06:43,956::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-274::DEBUG::2012-11-29 15:06:43,956::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`1e861e24-1ff8-46ac-9644-ff965fa6143d`::Granted request >Thread-274::DEBUG::2012-11-29 15:06:43,956::task::794::TaskManager.Task::(resourceAcquired) Task=`733f2cb9-4ad3-4c21-bd8b-c6362d5f6acb`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-274::DEBUG::2012-11-29 15:06:43,956::task::957::TaskManager.Task::(_decref) Task=`733f2cb9-4ad3-4c21-bd8b-c6362d5f6acb`::ref 1 aborting False >Thread-274::INFO::2012-11-29 15:06:43,957::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335032832', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-274::DEBUG::2012-11-29 15:06:43,957::task::1151::TaskManager.Task::(prepare) Task=`733f2cb9-4ad3-4c21-bd8b-c6362d5f6acb`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459335032832', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-274::DEBUG::2012-11-29 15:06:43,957::task::568::TaskManager.Task::(_updateState) Task=`733f2cb9-4ad3-4c21-bd8b-c6362d5f6acb`::moving from state preparing -> state finished >Thread-274::DEBUG::2012-11-29 15:06:43,957::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-274::DEBUG::2012-11-29 15:06:43,958::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-274::DEBUG::2012-11-29 15:06:43,958::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-274::DEBUG::2012-11-29 15:06:43,958::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-274::DEBUG::2012-11-29 15:06:43,958::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-274::DEBUG::2012-11-29 15:06:43,958::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-274::DEBUG::2012-11-29 15:06:43,958::task::957::TaskManager.Task::(_decref) Task=`733f2cb9-4ad3-4c21-bd8b-c6362d5f6acb`::ref 0 aborting False >Thread-276::DEBUG::2012-11-29 15:06:45,655::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-276::DEBUG::2012-11-29 15:06:45,656::task::568::TaskManager.Task::(_updateState) Task=`78a5cd99-e55a-450a-9dc1-c2713b1d82b8`::moving from state init -> state preparing >Thread-276::INFO::2012-11-29 15:06:45,656::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-276::DEBUG::2012-11-29 15:06:45,656::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-276::DEBUG::2012-11-29 15:06:45,656::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 84ac9405-3ae2-442e-b238-8b47704a4983 >Thread-276::DEBUG::2012-11-29 15:06:45,657::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '84ac9405-3ae2-442e-b238-8b47704a4983'} >Thread-276::DEBUG::2012-11-29 15:06:45,657::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 945882a4-532b-4e54-978c-818bf855ea7c >Thread-276::DEBUG::2012-11-29 15:06:45,657::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '945882a4-532b-4e54-978c-818bf855ea7c'} >Thread-276::DEBUG::2012-11-29 15:06:45,657::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'84ac9405-3ae2-442e-b238-8b47704a4983': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '84ac9405-3ae2-442e-b238-8b47704a4983'}, '945882a4-532b-4e54-978c-818bf855ea7c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '945882a4-532b-4e54-978c-818bf855ea7c'}} >Thread-276::INFO::2012-11-29 15:06:45,657::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'84ac9405-3ae2-442e-b238-8b47704a4983': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '84ac9405-3ae2-442e-b238-8b47704a4983'}, '945882a4-532b-4e54-978c-818bf855ea7c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '945882a4-532b-4e54-978c-818bf855ea7c'}}} >Thread-276::DEBUG::2012-11-29 15:06:45,657::task::1151::TaskManager.Task::(prepare) Task=`78a5cd99-e55a-450a-9dc1-c2713b1d82b8`::finished: {'allTasksStatus': {'84ac9405-3ae2-442e-b238-8b47704a4983': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '84ac9405-3ae2-442e-b238-8b47704a4983'}, '945882a4-532b-4e54-978c-818bf855ea7c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '945882a4-532b-4e54-978c-818bf855ea7c'}}} >Thread-276::DEBUG::2012-11-29 15:06:45,657::task::568::TaskManager.Task::(_updateState) Task=`78a5cd99-e55a-450a-9dc1-c2713b1d82b8`::moving from state preparing -> state finished >Thread-276::DEBUG::2012-11-29 15:06:45,658::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-276::DEBUG::2012-11-29 15:06:45,658::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-276::DEBUG::2012-11-29 15:06:45,658::task::957::TaskManager.Task::(_decref) Task=`78a5cd99-e55a-450a-9dc1-c2713b1d82b8`::ref 0 aborting False >Thread-277::DEBUG::2012-11-29 15:06:45,725::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-277::DEBUG::2012-11-29 15:06:45,725::task::568::TaskManager.Task::(_updateState) Task=`1ce42ad6-6b9b-4238-a567-b55c1b40b492`::moving from state init -> state preparing >Thread-277::INFO::2012-11-29 15:06:45,725::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='945882a4-532b-4e54-978c-818bf855ea7c', spUUID=None, options=None) >Thread-277::DEBUG::2012-11-29 15:06:45,725::taskManager::161::TaskManager::(clearTask) Entry. taskID: 945882a4-532b-4e54-978c-818bf855ea7c >Thread-277::DEBUG::2012-11-29 15:06:45,726::taskManager::166::TaskManager::(clearTask) Return. >Thread-277::INFO::2012-11-29 15:06:45,726::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-277::DEBUG::2012-11-29 15:06:45,726::task::1151::TaskManager.Task::(prepare) Task=`1ce42ad6-6b9b-4238-a567-b55c1b40b492`::finished: None >Thread-277::DEBUG::2012-11-29 15:06:45,727::task::568::TaskManager.Task::(_updateState) Task=`1ce42ad6-6b9b-4238-a567-b55c1b40b492`::moving from state preparing -> state finished >Thread-277::DEBUG::2012-11-29 15:06:45,727::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-277::DEBUG::2012-11-29 15:06:45,727::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-277::DEBUG::2012-11-29 15:06:45,727::task::957::TaskManager.Task::(_decref) Task=`1ce42ad6-6b9b-4238-a567-b55c1b40b492`::ref 0 aborting False >Thread-278::DEBUG::2012-11-29 15:06:45,757::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-278::DEBUG::2012-11-29 15:06:45,758::task::568::TaskManager.Task::(_updateState) Task=`b3d0174f-744c-4e5b-9443-00cc6ff4536a`::moving from state init -> state preparing >Thread-278::INFO::2012-11-29 15:06:45,758::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='84ac9405-3ae2-442e-b238-8b47704a4983', spUUID=None, options=None) >Thread-278::DEBUG::2012-11-29 15:06:45,758::taskManager::161::TaskManager::(clearTask) Entry. taskID: 84ac9405-3ae2-442e-b238-8b47704a4983 >Thread-278::DEBUG::2012-11-29 15:06:45,759::taskManager::166::TaskManager::(clearTask) Return. >Thread-278::INFO::2012-11-29 15:06:45,759::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-278::DEBUG::2012-11-29 15:06:45,759::task::1151::TaskManager.Task::(prepare) Task=`b3d0174f-744c-4e5b-9443-00cc6ff4536a`::finished: None >Thread-278::DEBUG::2012-11-29 15:06:45,759::task::568::TaskManager.Task::(_updateState) Task=`b3d0174f-744c-4e5b-9443-00cc6ff4536a`::moving from state preparing -> state finished >Thread-278::DEBUG::2012-11-29 15:06:45,759::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-278::DEBUG::2012-11-29 15:06:45,759::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-278::DEBUG::2012-11-29 15:06:45,760::task::957::TaskManager.Task::(_decref) Task=`b3d0174f-744c-4e5b-9443-00cc6ff4536a`::ref 0 aborting False >Thread-279::DEBUG::2012-11-29 15:06:46,784::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmCreate with ({'custom': {'device_cb17a577-2b1a-49d1-9da0-20a554c9a88a': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=cb17a577-2b1a-49d1-9da0-20a554c9a88a, device=memballoon, type=balloon, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}, managed=false, plugged=true, readOnly=false, alias=balloon0}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbcdevice_218f3aab-d98c-4ecf-a264-c3b2bebe267ddevice_cb37c5fd-57b4-4611-976b-3609533f163d': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=cb37c5fd-57b4-4611-976b-3609533f163d, device=unix, type=channel, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel0}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbcdevice_218f3aab-d98c-4ecf-a264-c3b2bebe267ddevice_cb37c5fd-57b4-4611-976b-3609533f163ddevice_1d82f1b8-d8f2-4d70-871a-37e114526273': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=1d82f1b8-d8f2-4d70-871a-37e114526273, device=unix, type=channel, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel1}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbcdevice_218f3aab-d98c-4ecf-a264-c3b2bebe267d': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=218f3aab-d98c-4ecf-a264-c3b2bebe267d, device=virtio-serial, type=controller, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, managed=false, plugged=true, readOnly=false, alias=virtio-serial0}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbcdevice_218f3aab-d98c-4ecf-a264-c3b2bebe267ddevice_cb37c5fd-57b4-4611-976b-3609533f163ddevice_1d82f1b8-d8f2-4d70-871a-37e114526273device_8c6a93c3-55f0-4b50-a432-da8b1855e8e4': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=8c6a93c3-55f0-4b50-a432-da8b1855e8e4, device=spicevmc, type=channel, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel2}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbc': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=39dea67f-a374-45e3-ac7b-818b56fb6dbc, device=ide, type=controller, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, alias=ide0}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.3.0', 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'devices': [{'device': 'qxl', 'specParams': {'vram': '65536'}, 'type': 'video', 'deviceId': '0e9a6899-6786-4ca4-bc9e-977f0ee8816d', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'a10db588-8d57-46ee-9de5-07b96e5bd78d', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'iface': 'virtio', 'format': 'cow', 'type': 'disk', 'poolID': 'b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'volumeID': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'specParams': {}, 'readonly': 'false', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'deviceId': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'address': {'bus': '0x00', ' slot': '0x05', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': 'dbc7f9a3-594b-417e-8e76-2a20304cc634', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'c1541ebd-789d-4a11-9aaa-00575037e032'}], 'smp': '1', 'vmType': 'kvm', 'timeOffset': '0', 'memSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'restvm_LOCAL', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [207] >Thread-279::INFO::2012-11-29 15:06:46,784::API::604::vds::(_getNetworkIp) network None: using 0 >Thread-279::INFO::2012-11-29 15:06:46,784::clientIF::346::vds::(createVm) vmContainerLock acquired by vm 302eb6e8-593b-42dc-acef-b27ca1440fa8 >Thread-280::DEBUG::2012-11-29 15:06:46,787::vm::635::vm.Vm::(_startUnderlyingVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Start >Thread-279::DEBUG::2012-11-29 15:06:46,787::clientIF::360::vds::(createVm) Total desktops after creation of 302eb6e8-593b-42dc-acef-b27ca1440fa8 is 1 >Thread-279::DEBUG::2012-11-29 15:06:46,787::BindingXMLRPC::910::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.3.0', 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'pid': '0', 'timeOffset': '0', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_cb17a577-2b1a-49d1-9da0-20a554c9a88a': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=cb17a577-2b1a-49d1-9da0-20a554c9a88a, device=memballoon, type=balloon, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}, managed=false, plugged=true, readOnly=false, alias=balloon0}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbcdevice_218f3aab-d98c-4ecf-a264-c3b2bebe267ddevice_cb37c5fd-57b4-4611-976b-3609533f163d': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=cb37c5fd-57b4-4611-976b-3609533f163d, device=unix, type=channel, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel0}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbcdevice_218f3aab-d98c-4ecf-a264-c3b2bebe267ddevice_cb37c5fd-57b4-4611-976b-3609533f163ddevice_1d82f1b8-d8f2-4d70-871a-37e114526273': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=1d82f1b8-d8f2-4d70-871a-37e114526273, device=unix, type=channel, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel1}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbcdevice_218f3aab-d98c-4ecf-a264-c3b2bebe267d': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=218f3aab-d98c-4ecf-a264-c3b2bebe267d, device=virtio-serial, type=controller, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, managed=false, plugged=true, readOnly=false, alias=virtio-serial0}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbcdevice_218f3aab-d98c-4ecf-a264-c3b2bebe267ddevice_cb37c5fd-57b4-4611-976b-3609533f163ddevice_1d82f1b8-d8f2-4d70-871a-37e114526273device_8c6a93c3-55f0-4b50-a432-da8b1855e8e4': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=8c6a93c3-55f0-4b50-a432-da8b1855e8e4, device=spicevmc, type=channel, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel2}', 'device_cb17a577-2b1a-49d1-9da0-20a554c9a88adevice_39dea67f-a374-45e3-ac7b-818b56fb6dbc': 'VmDevice {vmId=302eb6e8-593b-42dc-acef-b27ca1440fa8, deviceId=39dea67f-a374-45e3-ac7b-818b56fb6dbc, device=ide, type=controller, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, alias=ide0}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '65536'}, 'type': 'video', 'deviceId': '0e9a6899-6786-4ca4-bc9e-977f0ee8816d', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'a10db588-8d57-46ee-9de5-07b96e5bd78d', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'iface': 'virtio', 'format': 'cow', 'type': 'disk', 'poolID': 'b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'volumeID': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'specParams': {}, 'readonly': 'false', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'deviceId': '50a29df1-06f6-425d-9d8f-0684e13f85c7', 'address': {'bus': '0x00', ' slot': '0x05', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': 'dbc7f9a3-594b-417e-8e76-2a20304cc634', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'c1541ebd-789d-4a11-9aaa-00575037e032'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'restvm_LOCAL', 'display': 'qxl', 'nice': '0'}} >Thread-280::DEBUG::2012-11-29 15:06:46,787::vm::639::vm.Vm::(_startUnderlyingVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::_ongoingCreations acquired >Thread-280::INFO::2012-11-29 15:06:46,789::libvirtvm::1361::vm.Vm::(_run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::VM wrapper has started >Thread-280::DEBUG::2012-11-29 15:06:46,789::task::568::TaskManager.Task::(_updateState) Task=`a38557cc-baae-4552-817f-fdbc45c411ed`::moving from state init -> state preparing >Thread-280::INFO::2012-11-29 15:06:46,790::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2', options=None) >Thread-280::DEBUG::2012-11-29 15:06:46,792::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-280::INFO::2012-11-29 15:06:46,794::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '139264', 'apparentsize': '262144'} >Thread-280::DEBUG::2012-11-29 15:06:46,794::task::1151::TaskManager.Task::(prepare) Task=`a38557cc-baae-4552-817f-fdbc45c411ed`::finished: {'truesize': '139264', 'apparentsize': '262144'} >Thread-280::DEBUG::2012-11-29 15:06:46,794::task::568::TaskManager.Task::(_updateState) Task=`a38557cc-baae-4552-817f-fdbc45c411ed`::moving from state preparing -> state finished >Thread-280::DEBUG::2012-11-29 15:06:46,794::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-280::DEBUG::2012-11-29 15:06:46,794::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-280::DEBUG::2012-11-29 15:06:46,794::task::957::TaskManager.Task::(_decref) Task=`a38557cc-baae-4552-817f-fdbc45c411ed`::ref 0 aborting False >Thread-280::INFO::2012-11-29 15:06:46,795::clientIF::328::vds::(prepareVolumePath) prepared volume path: >Thread-280::DEBUG::2012-11-29 15:06:46,795::task::568::TaskManager.Task::(_updateState) Task=`917d83c8-dbdf-4d16-be69-b96b4d3995c5`::moving from state init -> state preparing >Thread-280::INFO::2012-11-29 15:06:46,795::logUtils::37::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2') >Thread-280::DEBUG::2012-11-29 15:06:46,795::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`1b59109a-6b16-416e-b4bb-1d10708cd787`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-280::DEBUG::2012-11-29 15:06:46,796::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-280::DEBUG::2012-11-29 15:06:46,796::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-280::DEBUG::2012-11-29 15:06:46,796::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`1b59109a-6b16-416e-b4bb-1d10708cd787`::Granted request >Thread-280::DEBUG::2012-11-29 15:06:46,796::task::794::TaskManager.Task::(resourceAcquired) Task=`917d83c8-dbdf-4d16-be69-b96b4d3995c5`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-280::DEBUG::2012-11-29 15:06:46,796::task::957::TaskManager.Task::(_decref) Task=`917d83c8-dbdf-4d16-be69-b96b4d3995c5`::ref 1 aborting False >Thread-280::DEBUG::2012-11-29 15:06:46,797::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-280::INFO::2012-11-29 15:06:46,808::image::344::Storage.Image::(getChain) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 imgUUID=50a29df1-06f6-425d-9d8f-0684e13f85c7 chain=[<storage.fileVolume.FileVolume object at 0x7fc0fc629890>] >Thread-280::INFO::2012-11-29 15:06:46,809::logUtils::39::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'chain': [{'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'volumeID': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}]} >Thread-280::DEBUG::2012-11-29 15:06:46,809::task::1151::TaskManager.Task::(prepare) Task=`917d83c8-dbdf-4d16-be69-b96b4d3995c5`::finished: {'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'chain': [{'path': '/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'domainID': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'volumeID': '55fc471b-3a43-4776-9330-d2dcf3b65ea2', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}]} >Thread-280::DEBUG::2012-11-29 15:06:46,809::task::568::TaskManager.Task::(_updateState) Task=`917d83c8-dbdf-4d16-be69-b96b4d3995c5`::moving from state preparing -> state finished >Thread-280::DEBUG::2012-11-29 15:06:46,809::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-280::DEBUG::2012-11-29 15:06:46,810::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-280::DEBUG::2012-11-29 15:06:46,810::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-280::DEBUG::2012-11-29 15:06:46,810::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-280::DEBUG::2012-11-29 15:06:46,810::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-280::DEBUG::2012-11-29 15:06:46,810::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-280::DEBUG::2012-11-29 15:06:46,811::task::957::TaskManager.Task::(_decref) Task=`917d83c8-dbdf-4d16-be69-b96b4d3995c5`::ref 0 aborting False >Thread-280::INFO::2012-11-29 15:06:46,811::clientIF::328::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-280::DEBUG::2012-11-29 15:06:46,819::libvirtvm::1415::vm.Vm::(_run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>restvm_LOCAL</name> > <uuid>302eb6e8-593b-42dc-acef-b27ca1440fa8</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu>1</vcpu> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/restvm_LOCAL.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/restvm_LOCAL.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <console type="pty"> > <target port="0" type="virtio"/> > </console> > <sound model="ich6"> > <address domain="0x0000" function="0x0" slot="0x03" type="pci" bus="0x00"/> > </sound> > <video> > <address domain="0x0000" function="0x0" slot="0x02" type="pci" bus="0x00"/> > <model heads="1" type="qxl" vram="65536"/> > </video> > <memballoon model="virtio"/> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial></serial> > </disk> > <disk device="disk" snapshot="no" type="file"> > <address domain="0x0000" function="0x0" slot="0x05" type="pci" bus="0x00"/> > <source file="/rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313/images/50a29df1-06f6-425d-9d8f-0684e13f85c7/55fc471b-3a43-4776-9330-d2dcf3b65ea2"/> > <target bus="virtio" dev="vda"/> > <serial>50a29df1-06f6-425d-9d8f-0684e13f85c7</serial> > <driver cache="none" error_policy="stop" io="threads" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.3.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6Server-6.4.0.3.el6</entry> > <entry name="serial">bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7</entry> > <entry name="uuid">302eb6e8-593b-42dc-acef-b27ca1440fa8</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="1" threads="1"/> > </cpu> ></domain> > >libvirtEventLoop::DEBUG::2012-11-29 15:06:47,248::libvirtvm::2765::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::event Started detail 0 opaque None >Thread-280::DEBUG::2012-11-29 15:06:47,300::utils::346::vm.Vm::(start) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Start statistics collection >Thread-283::DEBUG::2012-11-29 15:06:47,300::utils::375::vm.Vm::(run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Stats thread started >Thread-283::DEBUG::2012-11-29 15:06:47,301::task::568::TaskManager.Task::(_updateState) Task=`81f34f72-c03b-422f-b732-0b679c57ddf2`::moving from state init -> state preparing >Thread-283::INFO::2012-11-29 15:06:47,302::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', volUUID='55fc471b-3a43-4776-9330-d2dcf3b65ea2', options=None) >Thread-280::DEBUG::2012-11-29 15:06:47,303::vmChannels::144::vds::(register) Add fileno 30 to listener's channels. >Thread-283::DEBUG::2012-11-29 15:06:47,304::fileVolume::561::Storage.Volume::(validateVolumePath) validate path for 55fc471b-3a43-4776-9330-d2dcf3b65ea2 >Thread-283::INFO::2012-11-29 15:06:47,306::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '139264', 'apparentsize': '262144'} >Thread-283::DEBUG::2012-11-29 15:06:47,306::task::1151::TaskManager.Task::(prepare) Task=`81f34f72-c03b-422f-b732-0b679c57ddf2`::finished: {'truesize': '139264', 'apparentsize': '262144'} >Thread-283::DEBUG::2012-11-29 15:06:47,306::task::568::TaskManager.Task::(_updateState) Task=`81f34f72-c03b-422f-b732-0b679c57ddf2`::moving from state preparing -> state finished >Thread-283::DEBUG::2012-11-29 15:06:47,306::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-283::DEBUG::2012-11-29 15:06:47,306::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-283::DEBUG::2012-11-29 15:06:47,307::task::957::TaskManager.Task::(_decref) Task=`81f34f72-c03b-422f-b732-0b679c57ddf2`::ref 0 aborting False >Thread-280::WARNING::2012-11-29 15:06:47,306::libvirtvm::1655::vm.Vm::(_readPauseCode) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::_readPauseCode unsupported by libvirt vm >VM Channels Listener::DEBUG::2012-11-29 15:06:47,343::vmChannels::71::vds::(_do_add_channels) fileno 30 was added to unconnected channels. >VM Channels Listener::DEBUG::2012-11-29 15:06:47,343::vmChannels::103::vds::(_handle_unconnected) Trying to connect fileno 30. >VM Channels Listener::DEBUG::2012-11-29 15:06:47,343::guestIF::95::vm.Vm::(_connect) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Attempting connection to /var/lib/libvirt/qemu/channels/restvm_LOCAL.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2012-11-29 15:06:47,344::guestIF::97::vm.Vm::(_connect) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Connected to /var/lib/libvirt/qemu/channels/restvm_LOCAL.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2012-11-29 15:06:47,344::vmChannels::106::vds::(_handle_unconnected) Connect fileno 30 was succeed. >Thread-280::DEBUG::2012-11-29 15:06:47,373::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) >Thread-280::DEBUG::2012-11-29 15:06:47,404::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-280::DEBUG::2012-11-29 15:06:47,405::vm::656::vm.Vm::(_startUnderlyingVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::_ongoingCreations released >Thread-285::DEBUG::2012-11-29 15:06:49,144::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-285::DEBUG::2012-11-29 15:06:49,144::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-285::DEBUG::2012-11-29 15:06:49,144::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-285::DEBUG::2012-11-29 15:06:49,144::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-285::DEBUG::2012-11-29 15:06:49,145::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-285::DEBUG::2012-11-29 15:06:49,145::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-285::DEBUG::2012-11-29 15:06:49,145::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '4095', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.84', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-286::DEBUG::2012-11-29 15:06:51,187::task::568::TaskManager.Task::(_updateState) Task=`9bf9c289-8b3b-439b-a524-6a834d565576`::moving from state init -> state preparing >Thread-286::INFO::2012-11-29 15:06:51,188::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286::INFO::2012-11-29 15:06:51,188::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0139269828796', 'lastCheck': '1.8', 'code': 0, 'valid': True}} >Thread-286::DEBUG::2012-11-29 15:06:51,188::task::1151::TaskManager.Task::(prepare) Task=`9bf9c289-8b3b-439b-a524-6a834d565576`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0139269828796', 'lastCheck': '1.8', 'code': 0, 'valid': True}} >Thread-286::DEBUG::2012-11-29 15:06:51,188::task::568::TaskManager.Task::(_updateState) Task=`9bf9c289-8b3b-439b-a524-6a834d565576`::moving from state preparing -> state finished >Thread-286::DEBUG::2012-11-29 15:06:51,188::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286::DEBUG::2012-11-29 15:06:51,189::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286::DEBUG::2012-11-29 15:06:51,189::task::957::TaskManager.Task::(_decref) Task=`9bf9c289-8b3b-439b-a524-6a834d565576`::ref 0 aborting False >Thread-287::DEBUG::2012-11-29 15:06:51,227::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287::DEBUG::2012-11-29 15:06:51,227::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-287::DEBUG::2012-11-29 15:06:51,227::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-287::DEBUG::2012-11-29 15:06:51,227::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-287::DEBUG::2012-11-29 15:06:51,227::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-289::DEBUG::2012-11-29 15:06:53,315::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-289::DEBUG::2012-11-29 15:06:53,315::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-289::DEBUG::2012-11-29 15:06:53,315::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-289::DEBUG::2012-11-29 15:06:53,316::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-289::DEBUG::2012-11-29 15:06:53,316::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-289::DEBUG::2012-11-29 15:06:53,316::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-289::DEBUG::2012-11-29 15:06:53,316::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '4095', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.92', 'elapsedTime': '6', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-290::DEBUG::2012-11-29 15:06:54,000::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-290::DEBUG::2012-11-29 15:06:54,000::task::568::TaskManager.Task::(_updateState) Task=`0736c74d-7d04-4964-8bf9-2827e820888f`::moving from state init -> state preparing >Thread-290::INFO::2012-11-29 15:06:54,001::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-290::INFO::2012-11-29 15:06:54,001::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-290::DEBUG::2012-11-29 15:06:54,001::task::1151::TaskManager.Task::(prepare) Task=`0736c74d-7d04-4964-8bf9-2827e820888f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-290::DEBUG::2012-11-29 15:06:54,001::task::568::TaskManager.Task::(_updateState) Task=`0736c74d-7d04-4964-8bf9-2827e820888f`::moving from state preparing -> state finished >Thread-290::DEBUG::2012-11-29 15:06:54,001::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-290::DEBUG::2012-11-29 15:06:54,002::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-290::DEBUG::2012-11-29 15:06:54,002::task::957::TaskManager.Task::(_decref) Task=`0736c74d-7d04-4964-8bf9-2827e820888f`::ref 0 aborting False >Thread-291::DEBUG::2012-11-29 15:06:54,027::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-291::DEBUG::2012-11-29 15:06:54,028::task::568::TaskManager.Task::(_updateState) Task=`f7bd3c7b-e30c-4fcf-8f0a-08fc4e564293`::moving from state init -> state preparing >Thread-291::INFO::2012-11-29 15:06:54,028::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-291::DEBUG::2012-11-29 15:06:54,028::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`c4ddd6bf-784a-4620-88db-8604b3aa89af`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-291::DEBUG::2012-11-29 15:06:54,029::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-291::DEBUG::2012-11-29 15:06:54,029::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-291::DEBUG::2012-11-29 15:06:54,029::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`c4ddd6bf-784a-4620-88db-8604b3aa89af`::Granted request >Thread-291::DEBUG::2012-11-29 15:06:54,029::task::794::TaskManager.Task::(resourceAcquired) Task=`f7bd3c7b-e30c-4fcf-8f0a-08fc4e564293`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-291::DEBUG::2012-11-29 15:06:54,029::task::957::TaskManager.Task::(_decref) Task=`f7bd3c7b-e30c-4fcf-8f0a-08fc4e564293`::ref 1 aborting False >Thread-291::INFO::2012-11-29 15:06:54,030::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459334877184', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-291::DEBUG::2012-11-29 15:06:54,030::task::1151::TaskManager.Task::(prepare) Task=`f7bd3c7b-e30c-4fcf-8f0a-08fc4e564293`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459334877184', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-291::DEBUG::2012-11-29 15:06:54,031::task::568::TaskManager.Task::(_updateState) Task=`f7bd3c7b-e30c-4fcf-8f0a-08fc4e564293`::moving from state preparing -> state finished >Thread-291::DEBUG::2012-11-29 15:06:54,031::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-291::DEBUG::2012-11-29 15:06:54,031::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-291::DEBUG::2012-11-29 15:06:54,031::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-291::DEBUG::2012-11-29 15:06:54,031::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-291::DEBUG::2012-11-29 15:06:54,031::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-291::DEBUG::2012-11-29 15:06:54,032::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-291::DEBUG::2012-11-29 15:06:54,032::task::957::TaskManager.Task::(_decref) Task=`f7bd3c7b-e30c-4fcf-8f0a-08fc4e564293`::ref 0 aborting False >Thread-293::DEBUG::2012-11-29 15:06:55,391::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-293::DEBUG::2012-11-29 15:06:55,391::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-293::DEBUG::2012-11-29 15:06:55,392::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-293::DEBUG::2012-11-29 15:06:55,392::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-293::DEBUG::2012-11-29 15:06:55,392::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-293::DEBUG::2012-11-29 15:06:55,392::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-293::DEBUG::2012-11-29 15:06:55,392::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '4095', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '2.00', 'elapsedTime': '8', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-295::DEBUG::2012-11-29 15:06:57,460::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmGetStats with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} >Thread-295::DEBUG::2012-11-29 15:06:57,460::libvirtvm::192::vm.Vm::(_getCpuStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-295::DEBUG::2012-11-29 15:06:57,460::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc stats not available >Thread-295::DEBUG::2012-11-29 15:06:57,461::libvirtvm::244::vm.Vm::(_getDiskStats) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda stats not available >Thread-295::DEBUG::2012-11-29 15:06:57,461::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk hdc latency not available >Thread-295::DEBUG::2012-11-29 15:06:57,461::libvirtvm::283::vm.Vm::(_getDiskLatency) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Disk vda latency not available >Thread-295::DEBUG::2012-11-29 15:06:57,461::BindingXMLRPC::910::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '4095', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '609220775704930004', 'balloonInfo': {'balloon_max': 1048576, 'balloon_cur': 1048576}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '302eb6e8-593b-42dc-acef-b27ca1440fa8', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '139264', 'apparentsize': '262144', 'imageID': '50a29df1-06f6-425d-9d8f-0684e13f85c7'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.06', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-296::DEBUG::2012-11-29 15:06:57,727::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call vmDestroy with ('302eb6e8-593b-42dc-acef-b27ca1440fa8',) {} flowID [208] >Thread-296::INFO::2012-11-29 15:06:57,727::API::308::vds::(destroy) vmContainerLock acquired by vm 302eb6e8-593b-42dc-acef-b27ca1440fa8 >Thread-296::DEBUG::2012-11-29 15:06:57,727::libvirtvm::2391::vm.Vm::(destroy) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::destroy Called >Thread-296::INFO::2012-11-29 15:06:57,727::libvirtvm::2340::vm.Vm::(releaseVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Release VM resources >Thread-296::DEBUG::2012-11-29 15:06:57,736::utils::353::vm.Vm::(stop) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Stop statistics collection >Thread-296::DEBUG::2012-11-29 15:06:57,736::vmChannels::152::vds::(unregister) Delete fileno 30 from listener. >Thread-283::DEBUG::2012-11-29 15:06:57,736::utils::384::vm.Vm::(run) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Stats thread finished >Thread-296::DEBUG::2012-11-29 15:06:58,192::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/service ksmtuned retune' (cwd None) >libvirtEventLoop::DEBUG::2012-11-29 15:06:58,196::libvirtvm::2765::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::event Stopped detail 1 opaque None >libvirtEventLoop::INFO::2012-11-29 15:06:58,197::vm::713::vm.Vm::(_onQemuDeath) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::underlying process disconnected >Thread-296::DEBUG::2012-11-29 15:06:58,220::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-296::DEBUG::2012-11-29 15:06:58,220::vmChannels::152::vds::(unregister) Delete fileno 30 from listener. >Thread-296::DEBUG::2012-11-29 15:06:58,221::task::568::TaskManager.Task::(_updateState) Task=`e00c12e8-31c0-489b-8b2f-a59caa6ecb78`::moving from state init -> state preparing >Thread-296::INFO::2012-11-29 15:06:58,221::logUtils::37::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='302eb6e8-593b-42dc-acef-b27ca1440fa8') >Thread-296::INFO::2012-11-29 15:06:58,222::logUtils::39::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-296::DEBUG::2012-11-29 15:06:58,223::task::1151::TaskManager.Task::(prepare) Task=`e00c12e8-31c0-489b-8b2f-a59caa6ecb78`::finished: None >Thread-296::DEBUG::2012-11-29 15:06:58,223::task::568::TaskManager.Task::(_updateState) Task=`e00c12e8-31c0-489b-8b2f-a59caa6ecb78`::moving from state preparing -> state finished >Thread-296::DEBUG::2012-11-29 15:06:58,223::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-296::DEBUG::2012-11-29 15:06:58,223::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-296::DEBUG::2012-11-29 15:06:58,223::task::957::TaskManager.Task::(_decref) Task=`e00c12e8-31c0-489b-8b2f-a59caa6ecb78`::ref 0 aborting False >Thread-296::DEBUG::2012-11-29 15:06:58,224::libvirtvm::2385::vm.Vm::(deleteVm) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Total desktops after destroy of 302eb6e8-593b-42dc-acef-b27ca1440fa8 is 0 >Thread-296::DEBUG::2012-11-29 15:06:58,224::BindingXMLRPC::910::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2012-11-29 15:06:58,225::vm::1031::vm.Vm::(setDownStatus) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Changed state to Down: Admin shut down >libvirtEventLoop::DEBUG::2012-11-29 15:06:58,226::vmChannels::152::vds::(unregister) Delete fileno 30 from listener. >libvirtEventLoop::DEBUG::2012-11-29 15:06:58,227::utils::353::vm.Vm::(stop) vmId=`302eb6e8-593b-42dc-acef-b27ca1440fa8`::Stop statistics collection >VM Channels Listener::DEBUG::2012-11-29 15:06:58,357::vmChannels::88::vds::(_do_del_channels) fileno 30 was removed from listener. >VM Channels Listener::DEBUG::2012-11-29 15:06:58,357::vmChannels::88::vds::(_do_del_channels) fileno 30 was removed from listener. >VM Channels Listener::DEBUG::2012-11-29 15:06:58,357::vmChannels::88::vds::(_do_del_channels) fileno 30 was removed from listener. >Thread-297::DEBUG::2012-11-29 15:06:59,130::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-297::DEBUG::2012-11-29 15:06:59,130::task::568::TaskManager.Task::(_updateState) Task=`577544bc-e9f6-4cfb-a64d-171d482f10f0`::moving from state init -> state preparing >Thread-297::INFO::2012-11-29 15:06:59,130::logUtils::37::dispatcher::(wrapper) Run and protect: removeVM(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', vmUUID='302eb6e8-593b-42dc-acef-b27ca1440fa8', sdUUID=None, options=None) >Thread-297::DEBUG::2012-11-29 15:06:59,131::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`9577108b-232b-4cde-8a7c-d50f0deb01b7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-297::DEBUG::2012-11-29 15:06:59,131::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-297::DEBUG::2012-11-29 15:06:59,131::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-297::DEBUG::2012-11-29 15:06:59,131::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`9577108b-232b-4cde-8a7c-d50f0deb01b7`::Granted request >Thread-297::DEBUG::2012-11-29 15:06:59,132::task::794::TaskManager.Task::(resourceAcquired) Task=`577544bc-e9f6-4cfb-a64d-171d482f10f0`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-297::DEBUG::2012-11-29 15:06:59,132::task::957::TaskManager.Task::(_decref) Task=`577544bc-e9f6-4cfb-a64d-171d482f10f0`::ref 1 aborting False >Thread-297::INFO::2012-11-29 15:06:59,132::sp::1296::Storage.StoragePool::(removeVM) spUUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f vmUUID=302eb6e8-593b-42dc-acef-b27ca1440fa8 sdUUID=None >Thread-297::INFO::2012-11-29 15:06:59,133::logUtils::39::dispatcher::(wrapper) Run and protect: removeVM, Return response: None >Thread-297::DEBUG::2012-11-29 15:06:59,133::task::1151::TaskManager.Task::(prepare) Task=`577544bc-e9f6-4cfb-a64d-171d482f10f0`::finished: None >Thread-297::DEBUG::2012-11-29 15:06:59,133::task::568::TaskManager.Task::(_updateState) Task=`577544bc-e9f6-4cfb-a64d-171d482f10f0`::moving from state preparing -> state finished >Thread-297::DEBUG::2012-11-29 15:06:59,133::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-297::DEBUG::2012-11-29 15:06:59,133::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-297::DEBUG::2012-11-29 15:06:59,134::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-297::DEBUG::2012-11-29 15:06:59,134::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-297::DEBUG::2012-11-29 15:06:59,134::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-297::DEBUG::2012-11-29 15:06:59,134::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-297::DEBUG::2012-11-29 15:06:59,134::task::957::TaskManager.Task::(_decref) Task=`577544bc-e9f6-4cfb-a64d-171d482f10f0`::ref 0 aborting False >Thread-298::DEBUG::2012-11-29 15:06:59,186::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-298::DEBUG::2012-11-29 15:06:59,186::task::568::TaskManager.Task::(_updateState) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::moving from state init -> state preparing >Thread-298::INFO::2012-11-29 15:06:59,186::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', imgUUID='50a29df1-06f6-425d-9d8f-0684e13f85c7', postZero='false', force='false') >Thread-298::INFO::2012-11-29 15:06:59,187::fileSD::302::Storage.StorageDomain::(validate) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-298::DEBUG::2012-11-29 15:06:59,188::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=e459136b318686b029466b3ded781bd95ae1ee44'] >Thread-298::DEBUG::2012-11-29 15:06:59,189::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7`ReqID=`3bb8529f-b9bb-47de-9358-f8b7ea4c62d3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-298::DEBUG::2012-11-29 15:06:59,189::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7' for lock type 'exclusive' >Thread-298::DEBUG::2012-11-29 15:06:59,189::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7' is free. Now locking as 'exclusive' (1 active user) >Thread-298::DEBUG::2012-11-29 15:06:59,190::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7`ReqID=`3bb8529f-b9bb-47de-9358-f8b7ea4c62d3`::Granted request >Thread-298::DEBUG::2012-11-29 15:06:59,190::task::794::TaskManager.Task::(resourceAcquired) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::_resourcesAcquired: Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7 (exclusive) >Thread-298::DEBUG::2012-11-29 15:06:59,190::task::957::TaskManager.Task::(_decref) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::ref 1 aborting False >Thread-298::DEBUG::2012-11-29 15:06:59,191::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`bac74924-4977-400c-9ea6-8511c3d2d5a8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-298::DEBUG::2012-11-29 15:06:59,191::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'shared' >Thread-298::DEBUG::2012-11-29 15:06:59,191::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'shared' (1 active user) >Thread-298::DEBUG::2012-11-29 15:06:59,191::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`bac74924-4977-400c-9ea6-8511c3d2d5a8`::Granted request >Thread-298::DEBUG::2012-11-29 15:06:59,192::task::794::TaskManager.Task::(resourceAcquired) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (shared) >Thread-298::DEBUG::2012-11-29 15:06:59,192::task::957::TaskManager.Task::(_decref) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::ref 1 aborting False >Thread-298::DEBUG::2012-11-29 15:06:59,196::task::719::TaskManager.Task::(_save) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa.temp >Thread-298::DEBUG::2012-11-29 15:06:59,224::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_50a29df1-06f6-425d-9d8f-0684e13f85c7 for task ad1561e6-b5a9-429b-8679-1a99d1c27dfa >Thread-298::INFO::2012-11-29 15:06:59,224::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-298::DEBUG::2012-11-29 15:06:59,225::task::1146::TaskManager.Task::(prepare) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::Prepare: 1 jobs exist, move to acquiring >Thread-298::DEBUG::2012-11-29 15:06:59,225::task::568::TaskManager.Task::(_updateState) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::moving from state preparing -> state acquiring >Thread-298::DEBUG::2012-11-29 15:06:59,225::task::719::TaskManager.Task::(_save) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa.temp >Thread-298::DEBUG::2012-11-29 15:06:59,242::task::568::TaskManager.Task::(_updateState) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::moving from state acquiring -> state queued >Thread-298::DEBUG::2012-11-29 15:06:59,243::task::719::TaskManager.Task::(_save) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa.temp >Thread-298::DEBUG::2012-11-29 15:06:59,259::taskManager::50::TaskManager::(_queueTask) queuing task: ad1561e6-b5a9-429b-8679-1a99d1c27dfa >Thread-298::DEBUG::2012-11-29 15:06:59,260::taskManager::56::TaskManager::(_queueTask) task queued: ad1561e6-b5a9-429b-8679-1a99d1c27dfa >Thread-2::DEBUG::2012-11-29 15:06:59,260::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,261::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: ad1561e6-b5a9-429b-8679-1a99d1c27dfa running: <bound method Task.commit of <storage.task.Task instance at 0x2886518>> with: None >Thread-298::DEBUG::2012-11-29 15:06:59,261::task::1148::TaskManager.Task::(prepare) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::returning >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,261::task::1159::TaskManager.Task::(commit) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::committing task: ad1561e6-b5a9-429b-8679-1a99d1c27dfa >Thread-298::DEBUG::2012-11-29 15:06:59,262::task::957::TaskManager.Task::(_decref) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::ref 0 aborting False >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,262::task::568::TaskManager.Task::(_updateState) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::moving from state queued -> state running >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,265::task::719::TaskManager.Task::(_save) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa.temp >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,285::task::872::TaskManager.Task::(_runJobs) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::Task.run: running job 0: deleteImage_50a29df1-06f6-425d-9d8f-0684e13f85c7: <function <lambda> at 0x2848c08> (args: () kwargs: {}) >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,285::task::304::TaskManager.Task::(run) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::Job.run: running deleteImage_50a29df1-06f6-425d-9d8f-0684e13f85c7: <function <lambda> at 0x2848c08> (args: () kwargs: {}) callback None >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,285::task::568::TaskManager.Task::(_updateState) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::moving from state running -> state finished >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,286::task::719::TaskManager.Task::(_save) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::_save: orig /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa temp /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd/master/tasks/ad1561e6-b5a9-429b-8679-1a99d1c27dfa.temp >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,302::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>, 'Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7': < ResourceRef 'Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7', isValid: 'True' obj: 'None'>} >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,302::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,302::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,302::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,303::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,303::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,303::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7' >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,303::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7' (0 active users) >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,304::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7' is free, finding out if anyone is waiting for it. >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,304::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.50a29df1-06f6-425d-9d8f-0684e13f85c7', Clearing records. >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,304::task::880::TaskManager.Task::(_runJobs) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::Task.run: exit - success: result True >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,304::task::957::TaskManager.Task::(_decref) Task=`ad1561e6-b5a9-429b-8679-1a99d1c27dfa`::ref 0 aborting False >ad1561e6-b5a9-429b-8679-1a99d1c27dfa::DEBUG::2012-11-29 15:06:59,304::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-300::DEBUG::2012-11-29 15:07:01,541::task::568::TaskManager.Task::(_updateState) Task=`840165e7-b0b6-47aa-8573-2d337b72edd3`::moving from state init -> state preparing >Thread-300::INFO::2012-11-29 15:07:01,541::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-300::INFO::2012-11-29 15:07:01,541::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000901222229004', 'lastCheck': '2.1', 'code': 0, 'valid': True}} >Thread-300::DEBUG::2012-11-29 15:07:01,541::task::1151::TaskManager.Task::(prepare) Task=`840165e7-b0b6-47aa-8573-2d337b72edd3`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.000901222229004', 'lastCheck': '2.1', 'code': 0, 'valid': True}} >Thread-300::DEBUG::2012-11-29 15:07:01,541::task::568::TaskManager.Task::(_updateState) Task=`840165e7-b0b6-47aa-8573-2d337b72edd3`::moving from state preparing -> state finished >Thread-300::DEBUG::2012-11-29 15:07:01,541::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-300::DEBUG::2012-11-29 15:07:01,542::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-300::DEBUG::2012-11-29 15:07:01,542::task::957::TaskManager.Task::(_decref) Task=`840165e7-b0b6-47aa-8573-2d337b72edd3`::ref 0 aborting False >Thread-303::DEBUG::2012-11-29 15:07:04,078::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-303::DEBUG::2012-11-29 15:07:04,079::task::568::TaskManager.Task::(_updateState) Task=`e6b541e0-711d-4e51-b327-1f1ef9ec2959`::moving from state init -> state preparing >Thread-303::INFO::2012-11-29 15:07:04,079::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-303::INFO::2012-11-29 15:07:04,079::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-303::DEBUG::2012-11-29 15:07:04,079::task::1151::TaskManager.Task::(prepare) Task=`e6b541e0-711d-4e51-b327-1f1ef9ec2959`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-303::DEBUG::2012-11-29 15:07:04,079::task::568::TaskManager.Task::(_updateState) Task=`e6b541e0-711d-4e51-b327-1f1ef9ec2959`::moving from state preparing -> state finished >Thread-303::DEBUG::2012-11-29 15:07:04,080::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-303::DEBUG::2012-11-29 15:07:04,080::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-303::DEBUG::2012-11-29 15:07:04,080::task::957::TaskManager.Task::(_decref) Task=`e6b541e0-711d-4e51-b327-1f1ef9ec2959`::ref 0 aborting False >Thread-304::DEBUG::2012-11-29 15:07:04,107::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-304::DEBUG::2012-11-29 15:07:04,108::task::568::TaskManager.Task::(_updateState) Task=`5b83debc-6696-49c5-8694-4ee8c6015ca2`::moving from state init -> state preparing >Thread-304::INFO::2012-11-29 15:07:04,108::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-304::DEBUG::2012-11-29 15:07:04,108::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`f5fc497a-c5fc-4235-92d0-7049f8897514`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-304::DEBUG::2012-11-29 15:07:04,109::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'shared' >Thread-304::DEBUG::2012-11-29 15:07:04,109::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'shared' (1 active user) >Thread-304::DEBUG::2012-11-29 15:07:04,109::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`f5fc497a-c5fc-4235-92d0-7049f8897514`::Granted request >Thread-304::DEBUG::2012-11-29 15:07:04,109::task::794::TaskManager.Task::(resourceAcquired) Task=`5b83debc-6696-49c5-8694-4ee8c6015ca2`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (shared) >Thread-304::DEBUG::2012-11-29 15:07:04,109::task::957::TaskManager.Task::(_decref) Task=`5b83debc-6696-49c5-8694-4ee8c6015ca2`::ref 1 aborting False >Thread-304::INFO::2012-11-29 15:07:04,110::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459336028160', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-304::DEBUG::2012-11-29 15:07:04,110::task::1151::TaskManager.Task::(prepare) Task=`5b83debc-6696-49c5-8694-4ee8c6015ca2`::finished: {'info': {'spm_id': 1, 'master_uuid': '4d25f33e-850f-4088-8f0b-e9cbc8276313', 'name': 'RestDataCenter_LOCAL', 'version': '3', 'domains': '4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'LOCALFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'status': 'Active', 'diskfree': '459336028160', 'alerts': [], 'disktotal': '485945925632'}}} >Thread-304::DEBUG::2012-11-29 15:07:04,111::task::568::TaskManager.Task::(_updateState) Task=`5b83debc-6696-49c5-8694-4ee8c6015ca2`::moving from state preparing -> state finished >Thread-304::DEBUG::2012-11-29 15:07:04,111::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-304::DEBUG::2012-11-29 15:07:04,111::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-304::DEBUG::2012-11-29 15:07:04,111::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-304::DEBUG::2012-11-29 15:07:04,111::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-304::DEBUG::2012-11-29 15:07:04,111::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-304::DEBUG::2012-11-29 15:07:04,112::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-304::DEBUG::2012-11-29 15:07:04,112::task::957::TaskManager.Task::(_decref) Task=`5b83debc-6696-49c5-8694-4ee8c6015ca2`::ref 0 aborting False >Thread-306::DEBUG::2012-11-29 15:07:05,696::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-306::DEBUG::2012-11-29 15:07:05,697::task::568::TaskManager.Task::(_updateState) Task=`9f39f54a-80d0-4373-b748-cf202edf608f`::moving from state init -> state preparing >Thread-306::INFO::2012-11-29 15:07:05,697::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-306::DEBUG::2012-11-29 15:07:05,697::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-306::DEBUG::2012-11-29 15:07:05,697::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: ad1561e6-b5a9-429b-8679-1a99d1c27dfa >Thread-306::DEBUG::2012-11-29 15:07:05,697::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ad1561e6-b5a9-429b-8679-1a99d1c27dfa'} >Thread-306::DEBUG::2012-11-29 15:07:05,697::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'ad1561e6-b5a9-429b-8679-1a99d1c27dfa': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ad1561e6-b5a9-429b-8679-1a99d1c27dfa'}} >Thread-306::INFO::2012-11-29 15:07:05,698::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ad1561e6-b5a9-429b-8679-1a99d1c27dfa': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ad1561e6-b5a9-429b-8679-1a99d1c27dfa'}}} >Thread-306::DEBUG::2012-11-29 15:07:05,698::task::1151::TaskManager.Task::(prepare) Task=`9f39f54a-80d0-4373-b748-cf202edf608f`::finished: {'allTasksStatus': {'ad1561e6-b5a9-429b-8679-1a99d1c27dfa': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ad1561e6-b5a9-429b-8679-1a99d1c27dfa'}}} >Thread-306::DEBUG::2012-11-29 15:07:05,698::task::568::TaskManager.Task::(_updateState) Task=`9f39f54a-80d0-4373-b748-cf202edf608f`::moving from state preparing -> state finished >Thread-306::DEBUG::2012-11-29 15:07:05,698::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-306::DEBUG::2012-11-29 15:07:05,698::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-306::DEBUG::2012-11-29 15:07:05,698::task::957::TaskManager.Task::(_decref) Task=`9f39f54a-80d0-4373-b748-cf202edf608f`::ref 0 aborting False >Thread-307::DEBUG::2012-11-29 15:07:05,814::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-307::DEBUG::2012-11-29 15:07:05,815::task::568::TaskManager.Task::(_updateState) Task=`f852d00e-f584-48ef-8099-8daf07277e1f`::moving from state init -> state preparing >Thread-307::INFO::2012-11-29 15:07:05,815::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='ad1561e6-b5a9-429b-8679-1a99d1c27dfa', spUUID=None, options=None) >Thread-307::DEBUG::2012-11-29 15:07:05,815::taskManager::161::TaskManager::(clearTask) Entry. taskID: ad1561e6-b5a9-429b-8679-1a99d1c27dfa >Thread-307::DEBUG::2012-11-29 15:07:05,816::taskManager::166::TaskManager::(clearTask) Return. >Thread-307::INFO::2012-11-29 15:07:05,816::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-307::DEBUG::2012-11-29 15:07:05,816::task::1151::TaskManager.Task::(prepare) Task=`f852d00e-f584-48ef-8099-8daf07277e1f`::finished: None >Thread-307::DEBUG::2012-11-29 15:07:05,816::task::568::TaskManager.Task::(_updateState) Task=`f852d00e-f584-48ef-8099-8daf07277e1f`::moving from state preparing -> state finished >Thread-307::DEBUG::2012-11-29 15:07:05,816::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-307::DEBUG::2012-11-29 15:07:05,816::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-307::DEBUG::2012-11-29 15:07:05,817::task::957::TaskManager.Task::(_decref) Task=`f852d00e-f584-48ef-8099-8daf07277e1f`::ref 0 aborting False >Thread-310::DEBUG::2012-11-29 15:07:10,471::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-310::DEBUG::2012-11-29 15:07:10,472::task::568::TaskManager.Task::(_updateState) Task=`76ab5eee-49f6-434c-b2cb-eb9bc46e58d2`::moving from state init -> state preparing >Thread-310::INFO::2012-11-29 15:07:10,472::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-310::DEBUG::2012-11-29 15:07:10,472::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`7a359ddb-f247-45ee-a502-779b301226cd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-310::DEBUG::2012-11-29 15:07:10,473::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-310::DEBUG::2012-11-29 15:07:10,473::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-310::DEBUG::2012-11-29 15:07:10,473::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`7a359ddb-f247-45ee-a502-779b301226cd`::Granted request >Thread-310::DEBUG::2012-11-29 15:07:10,473::task::794::TaskManager.Task::(resourceAcquired) Task=`76ab5eee-49f6-434c-b2cb-eb9bc46e58d2`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (exclusive) >Thread-310::DEBUG::2012-11-29 15:07:10,473::task::957::TaskManager.Task::(_decref) Task=`76ab5eee-49f6-434c-b2cb-eb9bc46e58d2`::ref 1 aborting False >Thread-310::DEBUG::2012-11-29 15:07:10,474::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`01337aec-1a86-4c79-9867-97216c7bae52`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-310::DEBUG::2012-11-29 15:07:10,474::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'exclusive' >Thread-310::DEBUG::2012-11-29 15:07:10,474::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'exclusive' (1 active user) >Thread-310::DEBUG::2012-11-29 15:07:10,474::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`01337aec-1a86-4c79-9867-97216c7bae52`::Granted request >Thread-310::DEBUG::2012-11-29 15:07:10,475::task::794::TaskManager.Task::(resourceAcquired) Task=`76ab5eee-49f6-434c-b2cb-eb9bc46e58d2`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (exclusive) >Thread-310::DEBUG::2012-11-29 15:07:10,475::task::957::TaskManager.Task::(_decref) Task=`76ab5eee-49f6-434c-b2cb-eb9bc46e58d2`::ref 1 aborting False >Thread-310::INFO::2012-11-29 15:07:10,475::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313 spUUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-310::INFO::2012-11-29 15:07:10,475::sp::1103::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-310::INFO::2012-11-29 15:07:10,476::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-310::DEBUG::2012-11-29 15:07:10,476::task::1151::TaskManager.Task::(prepare) Task=`76ab5eee-49f6-434c-b2cb-eb9bc46e58d2`::finished: None >Thread-310::DEBUG::2012-11-29 15:07:10,476::task::568::TaskManager.Task::(_updateState) Task=`76ab5eee-49f6-434c-b2cb-eb9bc46e58d2`::moving from state preparing -> state finished >Thread-310::DEBUG::2012-11-29 15:07:10,476::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>, 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-310::DEBUG::2012-11-29 15:07:10,476::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-310::DEBUG::2012-11-29 15:07:10,476::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-310::DEBUG::2012-11-29 15:07:10,477::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-310::DEBUG::2012-11-29 15:07:10,477::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-310::DEBUG::2012-11-29 15:07:10,477::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-310::DEBUG::2012-11-29 15:07:10,477::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-310::DEBUG::2012-11-29 15:07:10,477::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-310::DEBUG::2012-11-29 15:07:10,478::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-310::DEBUG::2012-11-29 15:07:10,478::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-310::DEBUG::2012-11-29 15:07:10,478::task::957::TaskManager.Task::(_decref) Task=`76ab5eee-49f6-434c-b2cb-eb9bc46e58d2`::ref 0 aborting False >Thread-311::DEBUG::2012-11-29 15:07:10,527::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-311::DEBUG::2012-11-29 15:07:10,527::task::568::TaskManager.Task::(_updateState) Task=`931fd889-e49f-4534-b1dd-27f4954a1e0e`::moving from state init -> state preparing >Thread-311::INFO::2012-11-29 15:07:10,528::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-311::DEBUG::2012-11-29 15:07:10,528::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-311::DEBUG::2012-11-29 15:07:10,528::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-311::INFO::2012-11-29 15:07:10,528::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-311::DEBUG::2012-11-29 15:07:10,528::task::1151::TaskManager.Task::(prepare) Task=`931fd889-e49f-4534-b1dd-27f4954a1e0e`::finished: {'allTasksStatus': {}} >Thread-311::DEBUG::2012-11-29 15:07:10,528::task::568::TaskManager.Task::(_updateState) Task=`931fd889-e49f-4534-b1dd-27f4954a1e0e`::moving from state preparing -> state finished >Thread-311::DEBUG::2012-11-29 15:07:10,529::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-311::DEBUG::2012-11-29 15:07:10,529::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-311::DEBUG::2012-11-29 15:07:10,529::task::957::TaskManager.Task::(_decref) Task=`931fd889-e49f-4534-b1dd-27f4954a1e0e`::ref 0 aborting False >Thread-312::DEBUG::2012-11-29 15:07:10,553::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-312::DEBUG::2012-11-29 15:07:10,553::task::568::TaskManager.Task::(_updateState) Task=`cc934ddd-8e8f-43d4-96bd-f149bdd49489`::moving from state init -> state preparing >Thread-312::INFO::2012-11-29 15:07:10,554::logUtils::37::dispatcher::(wrapper) Run and protect: spmStop(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-312::DEBUG::2012-11-29 15:07:10,554::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`4c9e854a-99c5-47ae-ba42-b8c434fa87a0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-312::DEBUG::2012-11-29 15:07:10,554::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-312::DEBUG::2012-11-29 15:07:10,554::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-312::DEBUG::2012-11-29 15:07:10,555::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`4c9e854a-99c5-47ae-ba42-b8c434fa87a0`::Granted request >Thread-312::DEBUG::2012-11-29 15:07:10,555::task::794::TaskManager.Task::(resourceAcquired) Task=`cc934ddd-8e8f-43d4-96bd-f149bdd49489`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (exclusive) >Thread-312::DEBUG::2012-11-29 15:07:10,555::task::957::TaskManager.Task::(_decref) Task=`cc934ddd-8e8f-43d4-96bd-f149bdd49489`::ref 1 aborting False >Thread-312::DEBUG::2012-11-29 15:07:10,555::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-312::DEBUG::2012-11-29 15:07:10,555::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`8975d500-156e-4c55-916a-4127d00d2509`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-312::DEBUG::2012-11-29 15:07:10,556::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-312::DEBUG::2012-11-29 15:07:10,556::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-312::DEBUG::2012-11-29 15:07:10,556::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`8975d500-156e-4c55-916a-4127d00d2509`::Granted request >Thread-312::DEBUG::2012-11-29 15:07:10,556::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-312::DEBUG::2012-11-29 15:07:10,557::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-312::DEBUG::2012-11-29 15:07:10,557::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-312::DEBUG::2012-11-29 15:07:10,557::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-312::DEBUG::2012-11-29 15:07:10,557::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-312::DEBUG::2012-11-29 15:07:10,557::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-312::DEBUG::2012-11-29 15:07:10,558::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1be27af3c0c94087970a09a1de896da9bc6a0089'] >Thread-312::DEBUG::2012-11-29 15:07:10,559::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-312::INFO::2012-11-29 15:07:10,559::safelease::239::SANLock::(release) Releasing cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-312::DEBUG::2012-11-29 15:07:10,575::safelease::250::SANLock::(release) Cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 successfully released >Thread-312::INFO::2012-11-29 15:07:10,575::logUtils::39::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-312::DEBUG::2012-11-29 15:07:10,575::task::1151::TaskManager.Task::(prepare) Task=`cc934ddd-8e8f-43d4-96bd-f149bdd49489`::finished: None >Thread-312::DEBUG::2012-11-29 15:07:10,576::task::568::TaskManager.Task::(_updateState) Task=`cc934ddd-8e8f-43d4-96bd-f149bdd49489`::moving from state preparing -> state finished >Thread-312::DEBUG::2012-11-29 15:07:10,576::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-312::DEBUG::2012-11-29 15:07:10,576::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-312::DEBUG::2012-11-29 15:07:10,576::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-312::DEBUG::2012-11-29 15:07:10,576::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-312::DEBUG::2012-11-29 15:07:10,576::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-312::DEBUG::2012-11-29 15:07:10,577::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-312::DEBUG::2012-11-29 15:07:10,577::task::957::TaskManager.Task::(_decref) Task=`cc934ddd-8e8f-43d4-96bd-f149bdd49489`::ref 0 aborting False >Thread-313::DEBUG::2012-11-29 15:07:10,610::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-313::DEBUG::2012-11-29 15:07:10,610::task::568::TaskManager.Task::(_updateState) Task=`a457e24f-0f21-4d26-956b-d09c791db61f`::moving from state init -> state preparing >Thread-313::INFO::2012-11-29 15:07:10,610::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', hostID=1, scsiKey='b39553bd-b94c-42e1-8e06-40483d5f3c3f', remove=False, options=None) >Thread-313::DEBUG::2012-11-29 15:07:10,610::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`609d7921-a281-4386-8ed4-aac6d8a8eaec`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-313::DEBUG::2012-11-29 15:07:10,611::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-313::DEBUG::2012-11-29 15:07:10,611::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-313::DEBUG::2012-11-29 15:07:10,611::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`609d7921-a281-4386-8ed4-aac6d8a8eaec`::Granted request >Thread-313::DEBUG::2012-11-29 15:07:10,611::task::794::TaskManager.Task::(resourceAcquired) Task=`a457e24f-0f21-4d26-956b-d09c791db61f`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (exclusive) >Thread-313::DEBUG::2012-11-29 15:07:10,611::task::957::TaskManager.Task::(_decref) Task=`a457e24f-0f21-4d26-956b-d09c791db61f`::ref 1 aborting False >Thread-313::INFO::2012-11-29 15:07:10,612::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool b39553bd-b94c-42e1-8e06-40483d5f3c3f >Thread-66::DEBUG::2012-11-29 15:07:10,612::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-66::INFO::2012-11-29 15:07:10,612::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 (id: 1) >Thread-314::DEBUG::2012-11-29 15:07:11,736::task::568::TaskManager.Task::(_updateState) Task=`f2c2fe1b-a348-4f0b-81f0-e05324000b73`::moving from state init -> state preparing >Thread-314::INFO::2012-11-29 15:07:11,736::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-314::INFO::2012-11-29 15:07:11,736::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00097393989563', 'lastCheck': '2.3', 'code': 0, 'valid': True}} >Thread-314::DEBUG::2012-11-29 15:07:11,737::task::1151::TaskManager.Task::(prepare) Task=`f2c2fe1b-a348-4f0b-81f0-e05324000b73`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.00097393989563', 'lastCheck': '2.3', 'code': 0, 'valid': True}} >Thread-314::DEBUG::2012-11-29 15:07:11,737::task::568::TaskManager.Task::(_updateState) Task=`f2c2fe1b-a348-4f0b-81f0-e05324000b73`::moving from state preparing -> state finished >Thread-314::DEBUG::2012-11-29 15:07:11,737::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-314::DEBUG::2012-11-29 15:07:11,737::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-314::DEBUG::2012-11-29 15:07:11,737::task::957::TaskManager.Task::(_decref) Task=`f2c2fe1b-a348-4f0b-81f0-e05324000b73`::ref 0 aborting False >Thread-66::DEBUG::2012-11-29 15:07:12,613::safelease::193::SANLock::(releaseHostId) Host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 released successfully (id: 1) >Thread-313::INFO::2012-11-29 15:07:12,613::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-313::DEBUG::2012-11-29 15:07:12,613::task::1151::TaskManager.Task::(prepare) Task=`a457e24f-0f21-4d26-956b-d09c791db61f`::finished: True >Thread-313::DEBUG::2012-11-29 15:07:12,613::task::568::TaskManager.Task::(_updateState) Task=`a457e24f-0f21-4d26-956b-d09c791db61f`::moving from state preparing -> state finished >Thread-313::DEBUG::2012-11-29 15:07:12,614::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-313::DEBUG::2012-11-29 15:07:12,614::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-313::DEBUG::2012-11-29 15:07:12,614::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-313::DEBUG::2012-11-29 15:07:12,614::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-313::DEBUG::2012-11-29 15:07:12,614::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-313::DEBUG::2012-11-29 15:07:12,614::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-313::DEBUG::2012-11-29 15:07:12,615::task::957::TaskManager.Task::(_decref) Task=`a457e24f-0f21-4d26-956b-d09c791db61f`::ref 0 aborting False >Thread-316::DEBUG::2012-11-29 15:07:12,653::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-316::DEBUG::2012-11-29 15:07:12,653::task::568::TaskManager.Task::(_updateState) Task=`dfd96525-a601-4e29-8e85-701f728aa85d`::moving from state init -> state preparing >Thread-316::INFO::2012-11-29 15:07:12,653::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '372edb4d-9429-4285-88aa-859409c5e0e3', 'port': ''}], options=None) >Thread-316::DEBUG::2012-11-29 15:07:12,654::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-316::DEBUG::2012-11-29 15:07:12,654::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-316::DEBUG::2012-11-29 15:07:12,654::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-316::DEBUG::2012-11-29 15:07:12,654::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-316::DEBUG::2012-11-29 15:07:12,654::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-316::DEBUG::2012-11-29 15:07:12,668::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-316::DEBUG::2012-11-29 15:07:12,668::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-316::DEBUG::2012-11-29 15:07:12,670::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-316::DEBUG::2012-11-29 15:07:12,672::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-316::DEBUG::2012-11-29 15:07:12,674::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-316::DEBUG::2012-11-29 15:07:12,676::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-316::DEBUG::2012-11-29 15:07:12,678::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-316::DEBUG::2012-11-29 15:07:12,680::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-316::DEBUG::2012-11-29 15:07:12,682::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-316::DEBUG::2012-11-29 15:07:12,684::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-316::DEBUG::2012-11-29 15:07:14,687::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-316::DEBUG::2012-11-29 15:07:14,778::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-316::DEBUG::2012-11-29 15:07:14,778::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-316::DEBUG::2012-11-29 15:07:14,783::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-316::DEBUG::2012-11-29 15:07:14,783::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-316::DEBUG::2012-11-29 15:07:14,783::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-316::DEBUG::2012-11-29 15:07:14,783::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-316::DEBUG::2012-11-29 15:07:14,784::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-316::DEBUG::2012-11-29 15:07:14,784::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-316::INFO::2012-11-29 15:07:14,784::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-316::DEBUG::2012-11-29 15:07:14,784::task::1151::TaskManager.Task::(prepare) Task=`dfd96525-a601-4e29-8e85-701f728aa85d`::finished: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-316::DEBUG::2012-11-29 15:07:14,785::task::568::TaskManager.Task::(_updateState) Task=`dfd96525-a601-4e29-8e85-701f728aa85d`::moving from state preparing -> state finished >Thread-316::DEBUG::2012-11-29 15:07:14,785::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-316::DEBUG::2012-11-29 15:07:14,785::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-316::DEBUG::2012-11-29 15:07:14,785::task::957::TaskManager.Task::(_decref) Task=`dfd96525-a601-4e29-8e85-701f728aa85d`::ref 0 aborting False >Thread-319::DEBUG::2012-11-29 15:07:15,899::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-319::DEBUG::2012-11-29 15:07:15,899::task::568::TaskManager.Task::(_updateState) Task=`a407f61b-38a4-4198-a939-b0f104537a8d`::moving from state init -> state preparing >Thread-319::INFO::2012-11-29 15:07:15,900::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '372edb4d-9429-4285-88aa-859409c5e0e3', 'port': ''}], options=None) >Thread-319::INFO::2012-11-29 15:07:15,900::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-319::DEBUG::2012-11-29 15:07:15,900::task::1151::TaskManager.Task::(prepare) Task=`a407f61b-38a4-4198-a939-b0f104537a8d`::finished: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-319::DEBUG::2012-11-29 15:07:15,900::task::568::TaskManager.Task::(_updateState) Task=`a407f61b-38a4-4198-a939-b0f104537a8d`::moving from state preparing -> state finished >Thread-319::DEBUG::2012-11-29 15:07:15,900::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-319::DEBUG::2012-11-29 15:07:15,900::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-319::DEBUG::2012-11-29 15:07:15,901::task::957::TaskManager.Task::(_decref) Task=`a407f61b-38a4-4198-a939-b0f104537a8d`::ref 0 aborting False >Thread-320::DEBUG::2012-11-29 15:07:15,931::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-320::DEBUG::2012-11-29 15:07:15,931::task::568::TaskManager.Task::(_updateState) Task=`a4efcc69-2318-4108-b135-41097d6879a0`::moving from state init -> state preparing >Thread-320::INFO::2012-11-29 15:07:15,931::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '372edb4d-9429-4285-88aa-859409c5e0e3', 'port': ''}], options=None) >Thread-320::INFO::2012-11-29 15:07:15,936::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-320::DEBUG::2012-11-29 15:07:15,936::task::1151::TaskManager.Task::(prepare) Task=`a4efcc69-2318-4108-b135-41097d6879a0`::finished: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-320::DEBUG::2012-11-29 15:07:15,936::task::568::TaskManager.Task::(_updateState) Task=`a4efcc69-2318-4108-b135-41097d6879a0`::moving from state preparing -> state finished >Thread-320::DEBUG::2012-11-29 15:07:15,936::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-320::DEBUG::2012-11-29 15:07:15,936::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-320::DEBUG::2012-11-29 15:07:15,936::task::957::TaskManager.Task::(_decref) Task=`a4efcc69-2318-4108-b135-41097d6879a0`::ref 0 aborting False >Thread-321::DEBUG::2012-11-29 15:07:15,966::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-321::DEBUG::2012-11-29 15:07:15,966::task::568::TaskManager.Task::(_updateState) Task=`7dd06693-8e3b-4abb-8c4d-5e13b259dd02`::moving from state init -> state preparing >Thread-321::INFO::2012-11-29 15:07:15,966::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', hostID=1, scsiKey='b39553bd-b94c-42e1-8e06-40483d5f3c3f', msdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', masterVersion=1, options=None) >Thread-321::DEBUG::2012-11-29 15:07:15,967::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`6be5a4ae-a5a4-4380-8297-c1730300c8f9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-321::DEBUG::2012-11-29 15:07:15,967::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-321::DEBUG::2012-11-29 15:07:15,967::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-321::DEBUG::2012-11-29 15:07:15,967::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`6be5a4ae-a5a4-4380-8297-c1730300c8f9`::Granted request >Thread-321::INFO::2012-11-29 15:07:15,968::sp::628::Storage.StoragePool::(connect) Connect host #1 to the storage pool b39553bd-b94c-42e1-8e06-40483d5f3c3f with master domain: 4d25f33e-850f-4088-8f0b-e9cbc8276313 (ver = 1) >Thread-321::DEBUG::2012-11-29 15:07:15,968::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:15,968::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:15,968::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:15,969::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:15,969::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:15,969::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:15,969::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-321::DEBUG::2012-11-29 15:07:15,969::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-321::DEBUG::2012-11-29 15:07:15,970::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-321::DEBUG::2012-11-29 15:07:15,970::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-321::DEBUG::2012-11-29 15:07:15,970::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-321::DEBUG::2012-11-29 15:07:15,993::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2012-11-29 15:07:15,993::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-321::DEBUG::2012-11-29 15:07:15,995::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-321::DEBUG::2012-11-29 15:07:15,997::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-321::DEBUG::2012-11-29 15:07:15,999::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-321::DEBUG::2012-11-29 15:07:16,002::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-321::DEBUG::2012-11-29 15:07:16,004::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-321::DEBUG::2012-11-29 15:07:16,006::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-321::DEBUG::2012-11-29 15:07:16,008::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-321::DEBUG::2012-11-29 15:07:16,010::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-321::DEBUG::2012-11-29 15:07:18,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-321::DEBUG::2012-11-29 15:07:18,065::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2012-11-29 15:07:18,066::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,067::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,067::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,067::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,068::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,068::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,068::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-321::DEBUG::2012-11-29 15:07:18,069::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,070::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4d25f33e-850f-4088-8f0b-e9cbc8276313' (cwd None) >Thread-321::DEBUG::2012-11-29 15:07:18,253::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found\n'; <rc> = 5 >Thread-321::WARNING::2012-11-29 15:07:18,254::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found'] >Thread-321::DEBUG::2012-11-29 15:07:18,254::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,256::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-321::DEBUG::2012-11-29 15:07:18,256::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-321::DEBUG::2012-11-29 15:07:18,264::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1be27af3c0c94087970a09a1de896da9bc6a0089'] >Thread-321::DEBUG::2012-11-29 15:07:18,265::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-321::WARNING::2012-11-29 15:07:18,265::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS already registered >Thread-321::WARNING::2012-11-29 15:07:18,266::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_volumeNS already registered >Thread-321::DEBUG::2012-11-29 15:07:18,266::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 verified, version 1 >Thread-321::DEBUG::2012-11-29 15:07:18,266::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-321::DEBUG::2012-11-29 15:07:18,266::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-321::DEBUG::2012-11-29 15:07:18,268::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1be27af3c0c94087970a09a1de896da9bc6a0089'] >Thread-321::DEBUG::2012-11-29 15:07:18,269::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b39553bd-b94c-42e1-8e06-40483d5f3c3f` started monitoring domain `4d25f33e-850f-4088-8f0b-e9cbc8276313` >Thread-324::DEBUG::2012-11-29 15:07:18,269::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-321::DEBUG::2012-11-29 15:07:18,269::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-321::DEBUG::2012-11-29 15:07:18,272::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-321::DEBUG::2012-11-29 15:07:18,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-324::INFO::2012-11-29 15:07:18,283::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 (id: 1) >Thread-324::DEBUG::2012-11-29 15:07:18,284::safelease::178::SANLock::(acquireHostId) Host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 successfully acquired (id: 1) >Thread-321::DEBUG::2012-11-29 15:07:18,418::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-321::DEBUG::2012-11-29 15:07:18,419::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-321::INFO::2012-11-29 15:07:18,420::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 to /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-321::INFO::2012-11-29 15:07:18,421::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 to /rhev/data-center/b39553bd-b94c-42e1-8e06-40483d5f3c3f/mastersd >Thread-321::DEBUG::2012-11-29 15:07:18,421::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-321::DEBUG::2012-11-29 15:07:18,422::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-321::DEBUG::2012-11-29 15:07:18,422::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-321::DEBUG::2012-11-29 15:07:18,422::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-321::INFO::2012-11-29 15:07:18,422::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-321::DEBUG::2012-11-29 15:07:18,422::task::1151::TaskManager.Task::(prepare) Task=`7dd06693-8e3b-4abb-8c4d-5e13b259dd02`::finished: True >Thread-321::DEBUG::2012-11-29 15:07:18,423::task::568::TaskManager.Task::(_updateState) Task=`7dd06693-8e3b-4abb-8c4d-5e13b259dd02`::moving from state preparing -> state finished >Thread-321::DEBUG::2012-11-29 15:07:18,423::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-321::DEBUG::2012-11-29 15:07:18,423::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-321::DEBUG::2012-11-29 15:07:18,423::task::957::TaskManager.Task::(_decref) Task=`7dd06693-8e3b-4abb-8c4d-5e13b259dd02`::ref 0 aborting False >Thread-326::DEBUG::2012-11-29 15:07:18,503::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-326::DEBUG::2012-11-29 15:07:18,503::task::568::TaskManager.Task::(_updateState) Task=`5689f6cd-1998-41fd-b535-a9031d05fe5f`::moving from state init -> state preparing >Thread-326::INFO::2012-11-29 15:07:18,503::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-326::INFO::2012-11-29 15:07:18,503::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-326::DEBUG::2012-11-29 15:07:18,504::task::1151::TaskManager.Task::(prepare) Task=`5689f6cd-1998-41fd-b535-a9031d05fe5f`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-326::DEBUG::2012-11-29 15:07:18,504::task::568::TaskManager.Task::(_updateState) Task=`5689f6cd-1998-41fd-b535-a9031d05fe5f`::moving from state preparing -> state finished >Thread-326::DEBUG::2012-11-29 15:07:18,504::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-326::DEBUG::2012-11-29 15:07:18,504::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-326::DEBUG::2012-11-29 15:07:18,504::task::957::TaskManager.Task::(_decref) Task=`5689f6cd-1998-41fd-b535-a9031d05fe5f`::ref 0 aborting False >Thread-327::DEBUG::2012-11-29 15:07:18,539::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-327::DEBUG::2012-11-29 15:07:18,539::task::568::TaskManager.Task::(_updateState) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::moving from state init -> state preparing >Thread-327::INFO::2012-11-29 15:07:18,540::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', prevID=-1, prevLVER='0', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-327::DEBUG::2012-11-29 15:07:18,540::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`fef0a2f9-d4b7-4d77-afb1-2803a8300eff`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-327::DEBUG::2012-11-29 15:07:18,540::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-327::DEBUG::2012-11-29 15:07:18,541::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-327::DEBUG::2012-11-29 15:07:18,541::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`fef0a2f9-d4b7-4d77-afb1-2803a8300eff`::Granted request >Thread-327::DEBUG::2012-11-29 15:07:18,541::task::794::TaskManager.Task::(resourceAcquired) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (exclusive) >Thread-327::DEBUG::2012-11-29 15:07:18,541::task::957::TaskManager.Task::(_decref) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::ref 1 aborting False >Thread-327::INFO::2012-11-29 15:07:18,542::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-327::DEBUG::2012-11-29 15:07:18,542::task::1146::TaskManager.Task::(prepare) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::Prepare: 1 jobs exist, move to acquiring >Thread-327::DEBUG::2012-11-29 15:07:18,542::task::568::TaskManager.Task::(_updateState) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::moving from state preparing -> state acquiring >Thread-327::DEBUG::2012-11-29 15:07:18,542::task::568::TaskManager.Task::(_updateState) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::moving from state acquiring -> state queued >Thread-327::DEBUG::2012-11-29 15:07:18,542::taskManager::50::TaskManager::(_queueTask) queuing task: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-327::DEBUG::2012-11-29 15:07:18,543::taskManager::56::TaskManager::(_queueTask) task queued: deb1fda7-5136-42bb-ad29-faf8ebf34772 >7a4bf03d-a28e-47ab-bd72-599a52616647::DEBUG::2012-11-29 15:07:18,543::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-327::DEBUG::2012-11-29 15:07:18,544::task::1148::TaskManager.Task::(prepare) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::returning >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,544::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: deb1fda7-5136-42bb-ad29-faf8ebf34772 running: <bound method Task.commit of <storage.task.Task instance at 0x7fc0fc258758>> with: None >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,546::task::1159::TaskManager.Task::(commit) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::committing task: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-327::DEBUG::2012-11-29 15:07:18,546::task::957::TaskManager.Task::(_decref) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::ref 0 aborting False >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,547::task::568::TaskManager.Task::(_updateState) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::moving from state queued -> state running >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,548::task::872::TaskManager.Task::(_runJobs) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x2740cd0>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,550::task::304::TaskManager.Task::(run) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x2740cd0>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) callback None >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,551::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,551::misc::1027::SamplingMethod::(__call__) Got in to sampling method >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,553::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1be27af3c0c94087970a09a1de896da9bc6a0089'] >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,553::misc::1035::SamplingMethod::(__call__) Returning last result >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:18,554::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1be27af3c0c94087970a09a1de896da9bc6a0089'] >deb1fda7-5136-42bb-ad29-faf8ebf34772::INFO::2012-11-29 15:07:18,555::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 (id: 1) >Thread-328::DEBUG::2012-11-29 15:07:19,577::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-328::DEBUG::2012-11-29 15:07:19,578::task::568::TaskManager.Task::(_updateState) Task=`90dc0913-07bf-46b2-a0e0-ea20f7d75e69`::moving from state init -> state preparing >Thread-328::INFO::2012-11-29 15:07:19,578::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-328::DEBUG::2012-11-29 15:07:19,578::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-328::DEBUG::2012-11-29 15:07:19,578::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-328::INFO::2012-11-29 15:07:19,579::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-328::DEBUG::2012-11-29 15:07:19,579::task::1151::TaskManager.Task::(prepare) Task=`90dc0913-07bf-46b2-a0e0-ea20f7d75e69`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-328::DEBUG::2012-11-29 15:07:19,579::task::568::TaskManager.Task::(_updateState) Task=`90dc0913-07bf-46b2-a0e0-ea20f7d75e69`::moving from state preparing -> state finished >Thread-328::DEBUG::2012-11-29 15:07:19,579::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-328::DEBUG::2012-11-29 15:07:19,579::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-328::DEBUG::2012-11-29 15:07:19,579::task::957::TaskManager.Task::(_decref) Task=`90dc0913-07bf-46b2-a0e0-ea20f7d75e69`::ref 0 aborting False >Thread-330::DEBUG::2012-11-29 15:07:20,607::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-330::DEBUG::2012-11-29 15:07:20,608::task::568::TaskManager.Task::(_updateState) Task=`325f2c80-b701-4cef-98dc-a93eb1cd17d8`::moving from state init -> state preparing >Thread-330::INFO::2012-11-29 15:07:20,608::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-330::DEBUG::2012-11-29 15:07:20,608::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-330::DEBUG::2012-11-29 15:07:20,608::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-330::INFO::2012-11-29 15:07:20,608::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-330::DEBUG::2012-11-29 15:07:20,609::task::1151::TaskManager.Task::(prepare) Task=`325f2c80-b701-4cef-98dc-a93eb1cd17d8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-330::DEBUG::2012-11-29 15:07:20,609::task::568::TaskManager.Task::(_updateState) Task=`325f2c80-b701-4cef-98dc-a93eb1cd17d8`::moving from state preparing -> state finished >Thread-330::DEBUG::2012-11-29 15:07:20,609::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-330::DEBUG::2012-11-29 15:07:20,609::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-330::DEBUG::2012-11-29 15:07:20,609::task::957::TaskManager.Task::(_decref) Task=`325f2c80-b701-4cef-98dc-a93eb1cd17d8`::ref 0 aborting False >Thread-331::DEBUG::2012-11-29 15:07:21,637::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-331::DEBUG::2012-11-29 15:07:21,637::task::568::TaskManager.Task::(_updateState) Task=`2e6719b9-83a2-49ad-ab4e-cfcc222b133d`::moving from state init -> state preparing >Thread-331::INFO::2012-11-29 15:07:21,638::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-331::DEBUG::2012-11-29 15:07:21,638::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-331::DEBUG::2012-11-29 15:07:21,638::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-331::INFO::2012-11-29 15:07:21,638::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-331::DEBUG::2012-11-29 15:07:21,638::task::1151::TaskManager.Task::(prepare) Task=`2e6719b9-83a2-49ad-ab4e-cfcc222b133d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-331::DEBUG::2012-11-29 15:07:21,638::task::568::TaskManager.Task::(_updateState) Task=`2e6719b9-83a2-49ad-ab4e-cfcc222b133d`::moving from state preparing -> state finished >Thread-331::DEBUG::2012-11-29 15:07:21,638::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-331::DEBUG::2012-11-29 15:07:21,639::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-331::DEBUG::2012-11-29 15:07:21,639::task::957::TaskManager.Task::(_decref) Task=`2e6719b9-83a2-49ad-ab4e-cfcc222b133d`::ref 0 aborting False >Thread-332::DEBUG::2012-11-29 15:07:21,944::task::568::TaskManager.Task::(_updateState) Task=`c65a270a-8626-4140-aa71-337a21a4fdb1`::moving from state init -> state preparing >Thread-332::INFO::2012-11-29 15:07:21,944::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-332::INFO::2012-11-29 15:07:21,945::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0065290927887', 'lastCheck': '3.7', 'code': 0, 'valid': True}} >Thread-332::DEBUG::2012-11-29 15:07:21,945::task::1151::TaskManager.Task::(prepare) Task=`c65a270a-8626-4140-aa71-337a21a4fdb1`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0065290927887', 'lastCheck': '3.7', 'code': 0, 'valid': True}} >Thread-332::DEBUG::2012-11-29 15:07:21,945::task::568::TaskManager.Task::(_updateState) Task=`c65a270a-8626-4140-aa71-337a21a4fdb1`::moving from state preparing -> state finished >Thread-332::DEBUG::2012-11-29 15:07:21,945::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-332::DEBUG::2012-11-29 15:07:21,945::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-332::DEBUG::2012-11-29 15:07:21,945::task::957::TaskManager.Task::(_decref) Task=`c65a270a-8626-4140-aa71-337a21a4fdb1`::ref 0 aborting False >Thread-334::DEBUG::2012-11-29 15:07:22,667::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-334::DEBUG::2012-11-29 15:07:22,668::task::568::TaskManager.Task::(_updateState) Task=`33624486-ab39-4eb4-b077-012fad991f52`::moving from state init -> state preparing >Thread-334::INFO::2012-11-29 15:07:22,668::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-334::DEBUG::2012-11-29 15:07:22,668::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-334::DEBUG::2012-11-29 15:07:22,668::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-334::INFO::2012-11-29 15:07:22,668::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-334::DEBUG::2012-11-29 15:07:22,668::task::1151::TaskManager.Task::(prepare) Task=`33624486-ab39-4eb4-b077-012fad991f52`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-334::DEBUG::2012-11-29 15:07:22,669::task::568::TaskManager.Task::(_updateState) Task=`33624486-ab39-4eb4-b077-012fad991f52`::moving from state preparing -> state finished >Thread-334::DEBUG::2012-11-29 15:07:22,669::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-334::DEBUG::2012-11-29 15:07:22,669::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-334::DEBUG::2012-11-29 15:07:22,669::task::957::TaskManager.Task::(_decref) Task=`33624486-ab39-4eb4-b077-012fad991f52`::ref 0 aborting False >Thread-335::DEBUG::2012-11-29 15:07:23,697::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-335::DEBUG::2012-11-29 15:07:23,697::task::568::TaskManager.Task::(_updateState) Task=`b66e7784-f38f-42a6-9efd-0c8c44217466`::moving from state init -> state preparing >Thread-335::INFO::2012-11-29 15:07:23,697::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-335::DEBUG::2012-11-29 15:07:23,698::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-335::DEBUG::2012-11-29 15:07:23,698::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-335::INFO::2012-11-29 15:07:23,698::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-335::DEBUG::2012-11-29 15:07:23,698::task::1151::TaskManager.Task::(prepare) Task=`b66e7784-f38f-42a6-9efd-0c8c44217466`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-335::DEBUG::2012-11-29 15:07:23,698::task::568::TaskManager.Task::(_updateState) Task=`b66e7784-f38f-42a6-9efd-0c8c44217466`::moving from state preparing -> state finished >Thread-335::DEBUG::2012-11-29 15:07:23,698::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-335::DEBUG::2012-11-29 15:07:23,699::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-335::DEBUG::2012-11-29 15:07:23,699::task::957::TaskManager.Task::(_decref) Task=`b66e7784-f38f-42a6-9efd-0c8c44217466`::ref 0 aborting False >Thread-337::DEBUG::2012-11-29 15:07:24,726::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-337::DEBUG::2012-11-29 15:07:24,726::task::568::TaskManager.Task::(_updateState) Task=`a1cad1b2-9f98-4bd7-9ee3-a4e2ee402c1c`::moving from state init -> state preparing >Thread-337::INFO::2012-11-29 15:07:24,727::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-337::DEBUG::2012-11-29 15:07:24,727::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-337::DEBUG::2012-11-29 15:07:24,727::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-337::INFO::2012-11-29 15:07:24,727::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-337::DEBUG::2012-11-29 15:07:24,727::task::1151::TaskManager.Task::(prepare) Task=`a1cad1b2-9f98-4bd7-9ee3-a4e2ee402c1c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-337::DEBUG::2012-11-29 15:07:24,727::task::568::TaskManager.Task::(_updateState) Task=`a1cad1b2-9f98-4bd7-9ee3-a4e2ee402c1c`::moving from state preparing -> state finished >Thread-337::DEBUG::2012-11-29 15:07:24,728::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-337::DEBUG::2012-11-29 15:07:24,728::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-337::DEBUG::2012-11-29 15:07:24,728::task::957::TaskManager.Task::(_decref) Task=`a1cad1b2-9f98-4bd7-9ee3-a4e2ee402c1c`::ref 0 aborting False >Thread-338::DEBUG::2012-11-29 15:07:25,756::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-338::DEBUG::2012-11-29 15:07:25,756::task::568::TaskManager.Task::(_updateState) Task=`62cd25c2-ee2b-46c7-b3a2-7d5864528bf3`::moving from state init -> state preparing >Thread-338::INFO::2012-11-29 15:07:25,757::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-338::DEBUG::2012-11-29 15:07:25,757::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-338::DEBUG::2012-11-29 15:07:25,757::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-338::INFO::2012-11-29 15:07:25,757::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-338::DEBUG::2012-11-29 15:07:25,757::task::1151::TaskManager.Task::(prepare) Task=`62cd25c2-ee2b-46c7-b3a2-7d5864528bf3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-338::DEBUG::2012-11-29 15:07:25,757::task::568::TaskManager.Task::(_updateState) Task=`62cd25c2-ee2b-46c7-b3a2-7d5864528bf3`::moving from state preparing -> state finished >Thread-338::DEBUG::2012-11-29 15:07:25,758::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-338::DEBUG::2012-11-29 15:07:25,758::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-338::DEBUG::2012-11-29 15:07:25,758::task::957::TaskManager.Task::(_decref) Task=`62cd25c2-ee2b-46c7-b3a2-7d5864528bf3`::ref 0 aborting False >Thread-340::DEBUG::2012-11-29 15:07:26,779::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-340::DEBUG::2012-11-29 15:07:26,779::task::568::TaskManager.Task::(_updateState) Task=`420512b9-0148-4e24-98f6-66dca5592bde`::moving from state init -> state preparing >Thread-340::INFO::2012-11-29 15:07:26,779::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-340::DEBUG::2012-11-29 15:07:26,779::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-340::DEBUG::2012-11-29 15:07:26,779::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-340::INFO::2012-11-29 15:07:26,779::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-340::DEBUG::2012-11-29 15:07:26,780::task::1151::TaskManager.Task::(prepare) Task=`420512b9-0148-4e24-98f6-66dca5592bde`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-340::DEBUG::2012-11-29 15:07:26,780::task::568::TaskManager.Task::(_updateState) Task=`420512b9-0148-4e24-98f6-66dca5592bde`::moving from state preparing -> state finished >Thread-340::DEBUG::2012-11-29 15:07:26,780::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-340::DEBUG::2012-11-29 15:07:26,780::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-340::DEBUG::2012-11-29 15:07:26,780::task::957::TaskManager.Task::(_decref) Task=`420512b9-0148-4e24-98f6-66dca5592bde`::ref 0 aborting False >Thread-341::DEBUG::2012-11-29 15:07:27,807::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-341::DEBUG::2012-11-29 15:07:27,808::task::568::TaskManager.Task::(_updateState) Task=`7f2d348c-b75b-4dc2-8171-67f7af25e960`::moving from state init -> state preparing >Thread-341::INFO::2012-11-29 15:07:27,808::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-341::DEBUG::2012-11-29 15:07:27,808::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-341::DEBUG::2012-11-29 15:07:27,808::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-341::INFO::2012-11-29 15:07:27,808::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-341::DEBUG::2012-11-29 15:07:27,809::task::1151::TaskManager.Task::(prepare) Task=`7f2d348c-b75b-4dc2-8171-67f7af25e960`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-341::DEBUG::2012-11-29 15:07:27,809::task::568::TaskManager.Task::(_updateState) Task=`7f2d348c-b75b-4dc2-8171-67f7af25e960`::moving from state preparing -> state finished >Thread-341::DEBUG::2012-11-29 15:07:27,809::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-341::DEBUG::2012-11-29 15:07:27,809::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-341::DEBUG::2012-11-29 15:07:27,809::task::957::TaskManager.Task::(_decref) Task=`7f2d348c-b75b-4dc2-8171-67f7af25e960`::ref 0 aborting False >Thread-343::DEBUG::2012-11-29 15:07:28,837::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-343::DEBUG::2012-11-29 15:07:28,838::task::568::TaskManager.Task::(_updateState) Task=`880421fd-5129-4877-a3a9-8d8bfd0e7d32`::moving from state init -> state preparing >Thread-343::INFO::2012-11-29 15:07:28,838::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-343::DEBUG::2012-11-29 15:07:28,838::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-343::DEBUG::2012-11-29 15:07:28,838::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-343::INFO::2012-11-29 15:07:28,838::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-343::DEBUG::2012-11-29 15:07:28,838::task::1151::TaskManager.Task::(prepare) Task=`880421fd-5129-4877-a3a9-8d8bfd0e7d32`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-343::DEBUG::2012-11-29 15:07:28,839::task::568::TaskManager.Task::(_updateState) Task=`880421fd-5129-4877-a3a9-8d8bfd0e7d32`::moving from state preparing -> state finished >Thread-343::DEBUG::2012-11-29 15:07:28,839::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-343::DEBUG::2012-11-29 15:07:28,839::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-343::DEBUG::2012-11-29 15:07:28,839::task::957::TaskManager.Task::(_decref) Task=`880421fd-5129-4877-a3a9-8d8bfd0e7d32`::ref 0 aborting False >Thread-344::DEBUG::2012-11-29 15:07:29,868::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-344::DEBUG::2012-11-29 15:07:29,868::task::568::TaskManager.Task::(_updateState) Task=`387bc66e-93ff-462e-9928-eb88e1e8140a`::moving from state init -> state preparing >Thread-344::INFO::2012-11-29 15:07:29,868::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-344::DEBUG::2012-11-29 15:07:29,868::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-344::DEBUG::2012-11-29 15:07:29,868::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-344::INFO::2012-11-29 15:07:29,869::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-344::DEBUG::2012-11-29 15:07:29,869::task::1151::TaskManager.Task::(prepare) Task=`387bc66e-93ff-462e-9928-eb88e1e8140a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-344::DEBUG::2012-11-29 15:07:29,869::task::568::TaskManager.Task::(_updateState) Task=`387bc66e-93ff-462e-9928-eb88e1e8140a`::moving from state preparing -> state finished >Thread-344::DEBUG::2012-11-29 15:07:29,869::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-344::DEBUG::2012-11-29 15:07:29,869::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-344::DEBUG::2012-11-29 15:07:29,869::task::957::TaskManager.Task::(_decref) Task=`387bc66e-93ff-462e-9928-eb88e1e8140a`::ref 0 aborting False >Thread-346::DEBUG::2012-11-29 15:07:30,898::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-346::DEBUG::2012-11-29 15:07:30,898::task::568::TaskManager.Task::(_updateState) Task=`29d54f41-bcd6-423b-a4ed-4aa5ecb4f06a`::moving from state init -> state preparing >Thread-346::INFO::2012-11-29 15:07:30,898::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-346::DEBUG::2012-11-29 15:07:30,898::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-346::DEBUG::2012-11-29 15:07:30,899::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-346::INFO::2012-11-29 15:07:30,899::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-346::DEBUG::2012-11-29 15:07:30,899::task::1151::TaskManager.Task::(prepare) Task=`29d54f41-bcd6-423b-a4ed-4aa5ecb4f06a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-346::DEBUG::2012-11-29 15:07:30,899::task::568::TaskManager.Task::(_updateState) Task=`29d54f41-bcd6-423b-a4ed-4aa5ecb4f06a`::moving from state preparing -> state finished >Thread-346::DEBUG::2012-11-29 15:07:30,899::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-346::DEBUG::2012-11-29 15:07:30,899::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-346::DEBUG::2012-11-29 15:07:30,900::task::957::TaskManager.Task::(_decref) Task=`29d54f41-bcd6-423b-a4ed-4aa5ecb4f06a`::ref 0 aborting False >Thread-347::DEBUG::2012-11-29 15:07:31,928::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-347::DEBUG::2012-11-29 15:07:31,928::task::568::TaskManager.Task::(_updateState) Task=`662a8a99-e02d-45de-aa68-608eb348852f`::moving from state init -> state preparing >Thread-347::INFO::2012-11-29 15:07:31,929::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-347::DEBUG::2012-11-29 15:07:31,929::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-347::DEBUG::2012-11-29 15:07:31,929::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-347::INFO::2012-11-29 15:07:31,929::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-347::DEBUG::2012-11-29 15:07:31,929::task::1151::TaskManager.Task::(prepare) Task=`662a8a99-e02d-45de-aa68-608eb348852f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-347::DEBUG::2012-11-29 15:07:31,929::task::568::TaskManager.Task::(_updateState) Task=`662a8a99-e02d-45de-aa68-608eb348852f`::moving from state preparing -> state finished >Thread-347::DEBUG::2012-11-29 15:07:31,929::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-347::DEBUG::2012-11-29 15:07:31,930::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-347::DEBUG::2012-11-29 15:07:31,930::task::957::TaskManager.Task::(_decref) Task=`662a8a99-e02d-45de-aa68-608eb348852f`::ref 0 aborting False >Thread-348::DEBUG::2012-11-29 15:07:32,140::task::568::TaskManager.Task::(_updateState) Task=`a9d228c3-98bf-4362-9002-9ab6e4b3b3e6`::moving from state init -> state preparing >Thread-348::INFO::2012-11-29 15:07:32,140::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-348::INFO::2012-11-29 15:07:32,140::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0065290927887', 'lastCheck': '13.9', 'code': 0, 'valid': True}} >Thread-348::DEBUG::2012-11-29 15:07:32,140::task::1151::TaskManager.Task::(prepare) Task=`a9d228c3-98bf-4362-9002-9ab6e4b3b3e6`::finished: {'4d25f33e-850f-4088-8f0b-e9cbc8276313': {'delay': '0.0065290927887', 'lastCheck': '13.9', 'code': 0, 'valid': True}} >Thread-348::DEBUG::2012-11-29 15:07:32,140::task::568::TaskManager.Task::(_updateState) Task=`a9d228c3-98bf-4362-9002-9ab6e4b3b3e6`::moving from state preparing -> state finished >Thread-348::DEBUG::2012-11-29 15:07:32,141::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-348::DEBUG::2012-11-29 15:07:32,141::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-348::DEBUG::2012-11-29 15:07:32,141::task::957::TaskManager.Task::(_decref) Task=`a9d228c3-98bf-4362-9002-9ab6e4b3b3e6`::ref 0 aborting False >Thread-350::DEBUG::2012-11-29 15:07:32,958::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-350::DEBUG::2012-11-29 15:07:32,958::task::568::TaskManager.Task::(_updateState) Task=`b5fdc0c5-fb58-43d6-b569-e086e860c5bf`::moving from state init -> state preparing >Thread-350::INFO::2012-11-29 15:07:32,959::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-350::DEBUG::2012-11-29 15:07:32,959::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-350::DEBUG::2012-11-29 15:07:32,959::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-350::INFO::2012-11-29 15:07:32,959::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-350::DEBUG::2012-11-29 15:07:32,959::task::1151::TaskManager.Task::(prepare) Task=`b5fdc0c5-fb58-43d6-b569-e086e860c5bf`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-350::DEBUG::2012-11-29 15:07:32,959::task::568::TaskManager.Task::(_updateState) Task=`b5fdc0c5-fb58-43d6-b569-e086e860c5bf`::moving from state preparing -> state finished >Thread-350::DEBUG::2012-11-29 15:07:32,960::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-350::DEBUG::2012-11-29 15:07:32,960::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-350::DEBUG::2012-11-29 15:07:32,960::task::957::TaskManager.Task::(_decref) Task=`b5fdc0c5-fb58-43d6-b569-e086e860c5bf`::ref 0 aborting False >Thread-351::DEBUG::2012-11-29 15:07:33,990::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-351::DEBUG::2012-11-29 15:07:33,990::task::568::TaskManager.Task::(_updateState) Task=`14bfa148-cc27-45af-bf89-a18b9b78a604`::moving from state init -> state preparing >Thread-351::INFO::2012-11-29 15:07:33,990::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-351::DEBUG::2012-11-29 15:07:33,990::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-351::DEBUG::2012-11-29 15:07:33,991::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-351::INFO::2012-11-29 15:07:33,991::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-351::DEBUG::2012-11-29 15:07:33,991::task::1151::TaskManager.Task::(prepare) Task=`14bfa148-cc27-45af-bf89-a18b9b78a604`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-351::DEBUG::2012-11-29 15:07:33,991::task::568::TaskManager.Task::(_updateState) Task=`14bfa148-cc27-45af-bf89-a18b9b78a604`::moving from state preparing -> state finished >Thread-351::DEBUG::2012-11-29 15:07:33,991::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-351::DEBUG::2012-11-29 15:07:33,991::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-351::DEBUG::2012-11-29 15:07:33,991::task::957::TaskManager.Task::(_decref) Task=`14bfa148-cc27-45af-bf89-a18b9b78a604`::ref 0 aborting False >Thread-353::DEBUG::2012-11-29 15:07:35,020::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-353::DEBUG::2012-11-29 15:07:35,020::task::568::TaskManager.Task::(_updateState) Task=`a142a243-be55-474e-a955-3b703392b923`::moving from state init -> state preparing >Thread-353::INFO::2012-11-29 15:07:35,020::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-353::DEBUG::2012-11-29 15:07:35,021::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-353::DEBUG::2012-11-29 15:07:35,021::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-353::INFO::2012-11-29 15:07:35,021::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-353::DEBUG::2012-11-29 15:07:35,021::task::1151::TaskManager.Task::(prepare) Task=`a142a243-be55-474e-a955-3b703392b923`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-353::DEBUG::2012-11-29 15:07:35,021::task::568::TaskManager.Task::(_updateState) Task=`a142a243-be55-474e-a955-3b703392b923`::moving from state preparing -> state finished >Thread-353::DEBUG::2012-11-29 15:07:35,021::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-353::DEBUG::2012-11-29 15:07:35,021::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-353::DEBUG::2012-11-29 15:07:35,022::task::957::TaskManager.Task::(_decref) Task=`a142a243-be55-474e-a955-3b703392b923`::ref 0 aborting False >Thread-354::DEBUG::2012-11-29 15:07:36,050::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-354::DEBUG::2012-11-29 15:07:36,050::task::568::TaskManager.Task::(_updateState) Task=`1c62b780-f90a-4a3b-b2e6-3fe81f611760`::moving from state init -> state preparing >Thread-354::INFO::2012-11-29 15:07:36,050::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-354::DEBUG::2012-11-29 15:07:36,050::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-354::DEBUG::2012-11-29 15:07:36,051::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-354::INFO::2012-11-29 15:07:36,051::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-354::DEBUG::2012-11-29 15:07:36,051::task::1151::TaskManager.Task::(prepare) Task=`1c62b780-f90a-4a3b-b2e6-3fe81f611760`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-354::DEBUG::2012-11-29 15:07:36,051::task::568::TaskManager.Task::(_updateState) Task=`1c62b780-f90a-4a3b-b2e6-3fe81f611760`::moving from state preparing -> state finished >Thread-354::DEBUG::2012-11-29 15:07:36,051::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-354::DEBUG::2012-11-29 15:07:36,051::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-354::DEBUG::2012-11-29 15:07:36,052::task::957::TaskManager.Task::(_decref) Task=`1c62b780-f90a-4a3b-b2e6-3fe81f611760`::ref 0 aborting False >Thread-356::DEBUG::2012-11-29 15:07:37,079::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-356::DEBUG::2012-11-29 15:07:37,080::task::568::TaskManager.Task::(_updateState) Task=`5ad0392c-7995-48cd-9600-21b7f03a9a3c`::moving from state init -> state preparing >Thread-356::INFO::2012-11-29 15:07:37,080::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-356::DEBUG::2012-11-29 15:07:37,080::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-356::DEBUG::2012-11-29 15:07:37,080::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-356::INFO::2012-11-29 15:07:37,080::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-356::DEBUG::2012-11-29 15:07:37,080::task::1151::TaskManager.Task::(prepare) Task=`5ad0392c-7995-48cd-9600-21b7f03a9a3c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-356::DEBUG::2012-11-29 15:07:37,081::task::568::TaskManager.Task::(_updateState) Task=`5ad0392c-7995-48cd-9600-21b7f03a9a3c`::moving from state preparing -> state finished >Thread-356::DEBUG::2012-11-29 15:07:37,081::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-356::DEBUG::2012-11-29 15:07:37,081::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-356::DEBUG::2012-11-29 15:07:37,081::task::957::TaskManager.Task::(_decref) Task=`5ad0392c-7995-48cd-9600-21b7f03a9a3c`::ref 0 aborting False >Thread-357::DEBUG::2012-11-29 15:07:38,109::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-357::DEBUG::2012-11-29 15:07:38,109::task::568::TaskManager.Task::(_updateState) Task=`38aa0e67-c715-4d98-8d3c-e1cf2ef9c37f`::moving from state init -> state preparing >Thread-357::INFO::2012-11-29 15:07:38,109::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-357::DEBUG::2012-11-29 15:07:38,109::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-357::DEBUG::2012-11-29 15:07:38,110::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-357::INFO::2012-11-29 15:07:38,110::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-357::DEBUG::2012-11-29 15:07:38,110::task::1151::TaskManager.Task::(prepare) Task=`38aa0e67-c715-4d98-8d3c-e1cf2ef9c37f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-357::DEBUG::2012-11-29 15:07:38,110::task::568::TaskManager.Task::(_updateState) Task=`38aa0e67-c715-4d98-8d3c-e1cf2ef9c37f`::moving from state preparing -> state finished >Thread-357::DEBUG::2012-11-29 15:07:38,110::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-357::DEBUG::2012-11-29 15:07:38,110::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-357::DEBUG::2012-11-29 15:07:38,111::task::957::TaskManager.Task::(_decref) Task=`38aa0e67-c715-4d98-8d3c-e1cf2ef9c37f`::ref 0 aborting False >Thread-359::DEBUG::2012-11-29 15:07:39,138::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-359::DEBUG::2012-11-29 15:07:39,139::task::568::TaskManager.Task::(_updateState) Task=`cdc8d773-5999-4803-921f-a8cf22b8b2ee`::moving from state init -> state preparing >Thread-359::INFO::2012-11-29 15:07:39,139::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-359::DEBUG::2012-11-29 15:07:39,139::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-359::DEBUG::2012-11-29 15:07:39,139::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-359::INFO::2012-11-29 15:07:39,139::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-359::DEBUG::2012-11-29 15:07:39,139::task::1151::TaskManager.Task::(prepare) Task=`cdc8d773-5999-4803-921f-a8cf22b8b2ee`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-359::DEBUG::2012-11-29 15:07:39,140::task::568::TaskManager.Task::(_updateState) Task=`cdc8d773-5999-4803-921f-a8cf22b8b2ee`::moving from state preparing -> state finished >Thread-359::DEBUG::2012-11-29 15:07:39,140::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-359::DEBUG::2012-11-29 15:07:39,140::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-359::DEBUG::2012-11-29 15:07:39,140::task::957::TaskManager.Task::(_decref) Task=`cdc8d773-5999-4803-921f-a8cf22b8b2ee`::ref 0 aborting False >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,558::safelease::178::SANLock::(acquireHostId) Host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 successfully acquired (id: 1) >deb1fda7-5136-42bb-ad29-faf8ebf34772::INFO::2012-11-29 15:07:39,558::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 (id: 1) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,673::safelease::235::SANLock::(acquire) Cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 successfully acquired (id: 1) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,673::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,681::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1be27af3c0c94087970a09a1de896da9bc6a0089'] >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,682::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,682::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,682::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=c9dd6bb3f75c2ad3dd1488f4dc39b880d8ea0184'] >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,683::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,684::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`206309a3-e5a3-45c2-a635-716f430709db`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,684::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,684::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,684::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`206309a3-e5a3-45c2-a635-716f430709db`::Granted request >deb1fda7-5136-42bb-ad29-faf8ebf34772::INFO::2012-11-29 15:07:39,685::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `4d25f33e-850f-4088-8f0b-e9cbc8276313` >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,685::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`16acb1ee-c6a9-4590-b704-cbef52d914c2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,685::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'exclusive' >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,685::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'exclusive' (1 active user) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,685::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`16acb1ee-c6a9-4590-b704-cbef52d914c2`::Granted request >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,686::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,686::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4d25f33e-850f-4088-8f0b-e9cbc8276313' (cwd None) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,837::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found\n'; <rc> = 5 >deb1fda7-5136-42bb-ad29-faf8ebf34772::WARNING::2012-11-29 15:07:39,838::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found'] >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,839::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,840::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,841::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,842::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=4d25f33e-850f-4088-8f0b-e9cbc8276313:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=c9dd6bb3f75c2ad3dd1488f4dc39b880d8ea0184'] >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,844::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >deb1fda7-5136-42bb-ad29-faf8ebf34772::WARNING::2012-11-29 15:07:39,844::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS already registered >deb1fda7-5136-42bb-ad29-faf8ebf34772::WARNING::2012-11-29 15:07:39,844::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_volumeNS already registered >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,844::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,845::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,845::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,845::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,845::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,845::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,846::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,846::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,846::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,846::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,846::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,847::sp::309::Storage.StoragePool::(startSpm) ended. >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,848::task::568::TaskManager.Task::(_updateState) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::moving from state running -> state finished >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,848::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,848::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,848::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,848::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,849::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,849::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,849::task::880::TaskManager.Task::(_runJobs) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::Task.run: exit - success: result >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,849::task::957::TaskManager.Task::(_decref) Task=`deb1fda7-5136-42bb-ad29-faf8ebf34772`::ref 0 aborting False >deb1fda7-5136-42bb-ad29-faf8ebf34772::DEBUG::2012-11-29 15:07:39,849::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-361::DEBUG::2012-11-29 15:07:40,168::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-361::DEBUG::2012-11-29 15:07:40,169::task::568::TaskManager.Task::(_updateState) Task=`bbcce1f9-954f-4886-a4a4-ea3c15dcca9b`::moving from state init -> state preparing >Thread-361::INFO::2012-11-29 15:07:40,169::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-361::DEBUG::2012-11-29 15:07:40,169::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-361::DEBUG::2012-11-29 15:07:40,170::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'} >Thread-361::INFO::2012-11-29 15:07:40,170::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-361::DEBUG::2012-11-29 15:07:40,170::task::1151::TaskManager.Task::(prepare) Task=`bbcce1f9-954f-4886-a4a4-ea3c15dcca9b`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'deb1fda7-5136-42bb-ad29-faf8ebf34772'}} >Thread-361::DEBUG::2012-11-29 15:07:40,170::task::568::TaskManager.Task::(_updateState) Task=`bbcce1f9-954f-4886-a4a4-ea3c15dcca9b`::moving from state preparing -> state finished >Thread-361::DEBUG::2012-11-29 15:07:40,170::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-361::DEBUG::2012-11-29 15:07:40,171::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-361::DEBUG::2012-11-29 15:07:40,171::task::957::TaskManager.Task::(_decref) Task=`bbcce1f9-954f-4886-a4a4-ea3c15dcca9b`::ref 0 aborting False >Thread-362::DEBUG::2012-11-29 15:07:40,195::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-362::DEBUG::2012-11-29 15:07:40,195::task::568::TaskManager.Task::(_updateState) Task=`ae09d86c-fc36-43b3-a6f5-42a82f02a104`::moving from state init -> state preparing >Thread-362::INFO::2012-11-29 15:07:40,196::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-362::INFO::2012-11-29 15:07:40,196::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-362::DEBUG::2012-11-29 15:07:40,196::task::1151::TaskManager.Task::(prepare) Task=`ae09d86c-fc36-43b3-a6f5-42a82f02a104`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-362::DEBUG::2012-11-29 15:07:40,196::task::568::TaskManager.Task::(_updateState) Task=`ae09d86c-fc36-43b3-a6f5-42a82f02a104`::moving from state preparing -> state finished >Thread-362::DEBUG::2012-11-29 15:07:40,196::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-362::DEBUG::2012-11-29 15:07:40,197::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-362::DEBUG::2012-11-29 15:07:40,197::task::957::TaskManager.Task::(_decref) Task=`ae09d86c-fc36-43b3-a6f5-42a82f02a104`::ref 0 aborting False >Thread-363::DEBUG::2012-11-29 15:07:40,224::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-363::DEBUG::2012-11-29 15:07:40,224::task::568::TaskManager.Task::(_updateState) Task=`a79ebffc-f7f5-4eae-8865-a3d91f7e2893`::moving from state init -> state preparing >Thread-363::INFO::2012-11-29 15:07:40,224::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='deb1fda7-5136-42bb-ad29-faf8ebf34772', spUUID=None, options=None) >Thread-363::DEBUG::2012-11-29 15:07:40,224::taskManager::161::TaskManager::(clearTask) Entry. taskID: deb1fda7-5136-42bb-ad29-faf8ebf34772 >Thread-363::DEBUG::2012-11-29 15:07:40,224::taskManager::166::TaskManager::(clearTask) Return. >Thread-363::INFO::2012-11-29 15:07:40,225::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-363::DEBUG::2012-11-29 15:07:40,225::task::1151::TaskManager.Task::(prepare) Task=`a79ebffc-f7f5-4eae-8865-a3d91f7e2893`::finished: None >Thread-363::DEBUG::2012-11-29 15:07:40,225::task::568::TaskManager.Task::(_updateState) Task=`a79ebffc-f7f5-4eae-8865-a3d91f7e2893`::moving from state preparing -> state finished >Thread-363::DEBUG::2012-11-29 15:07:40,225::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-363::DEBUG::2012-11-29 15:07:40,225::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-363::DEBUG::2012-11-29 15:07:40,226::task::957::TaskManager.Task::(_decref) Task=`a79ebffc-f7f5-4eae-8865-a3d91f7e2893`::ref 0 aborting False >Thread-364::DEBUG::2012-11-29 15:07:40,265::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-364::DEBUG::2012-11-29 15:07:40,265::task::568::TaskManager.Task::(_updateState) Task=`69f3fe26-5f61-4efb-b272-569c1de154e9`::moving from state init -> state preparing >Thread-364::INFO::2012-11-29 15:07:40,265::logUtils::37::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', hostID=1, scsiKey='b39553bd-b94c-42e1-8e06-40483d5f3c3f', options=None) >Thread-364::INFO::2012-11-29 15:07:40,265::hsm::1035::Storage.HSM::(destroyStoragePool) spUUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f >Thread-364::DEBUG::2012-11-29 15:07:40,266::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`b3fffe4c-167d-468c-ab0e-8e5ea7cafae0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-364::DEBUG::2012-11-29 15:07:40,266::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-364::DEBUG::2012-11-29 15:07:40,266::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-364::DEBUG::2012-11-29 15:07:40,266::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`b3fffe4c-167d-468c-ab0e-8e5ea7cafae0`::Granted request >Thread-364::DEBUG::2012-11-29 15:07:40,267::task::794::TaskManager.Task::(resourceAcquired) Task=`69f3fe26-5f61-4efb-b272-569c1de154e9`::_resourcesAcquired: Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f (exclusive) >Thread-364::DEBUG::2012-11-29 15:07:40,267::task::957::TaskManager.Task::(_decref) Task=`69f3fe26-5f61-4efb-b272-569c1de154e9`::ref 1 aborting False >Thread-364::DEBUG::2012-11-29 15:07:40,267::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`dfbcbf2c-2209-4724-8988-5bde361e0346`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-364::DEBUG::2012-11-29 15:07:40,268::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'exclusive' >Thread-364::DEBUG::2012-11-29 15:07:40,268::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'exclusive' (1 active user) >Thread-364::DEBUG::2012-11-29 15:07:40,268::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`dfbcbf2c-2209-4724-8988-5bde361e0346`::Granted request >Thread-364::DEBUG::2012-11-29 15:07:40,268::task::794::TaskManager.Task::(resourceAcquired) Task=`69f3fe26-5f61-4efb-b272-569c1de154e9`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (exclusive) >Thread-364::DEBUG::2012-11-29 15:07:40,269::task::957::TaskManager.Task::(_decref) Task=`69f3fe26-5f61-4efb-b272-569c1de154e9`::ref 1 aborting False >Thread-364::WARNING::2012-11-29 15:07:40,269::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `4d25f33e-850f-4088-8f0b-e9cbc8276313` >Thread-364::DEBUG::2012-11-29 15:07:40,269::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-364::DEBUG::2012-11-29 15:07:40,269::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-364::DEBUG::2012-11-29 15:07:40,270::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=660bc0cf1e08f478cc2ccc775db14fd7f2ac8e34'] >Thread-364::DEBUG::2012-11-29 15:07:40,271::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-364::DEBUG::2012-11-29 15:07:40,271::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-364::DEBUG::2012-11-29 15:07:40,272::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`a050f0f4-e842-41c3-a47b-9260834b7a25`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-364::DEBUG::2012-11-29 15:07:40,272::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' for lock type 'exclusive' >Thread-364::DEBUG::2012-11-29 15:07:40,272::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free. Now locking as 'exclusive' (1 active user) >Thread-364::DEBUG::2012-11-29 15:07:40,272::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f`ReqID=`a050f0f4-e842-41c3-a47b-9260834b7a25`::Granted request >Thread-364::DEBUG::2012-11-29 15:07:40,273::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-364::DEBUG::2012-11-29 15:07:40,273::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-364::DEBUG::2012-11-29 15:07:40,273::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-364::DEBUG::2012-11-29 15:07:40,273::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-364::DEBUG::2012-11-29 15:07:40,274::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-364::DEBUG::2012-11-29 15:07:40,274::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-364::DEBUG::2012-11-29 15:07:40,274::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1947cca7ed0137c87d044cd956b46fa4fbb922e8'] >Thread-364::DEBUG::2012-11-29 15:07:40,276::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-364::INFO::2012-11-29 15:07:40,276::safelease::239::SANLock::(release) Releasing cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-364::DEBUG::2012-11-29 15:07:40,296::safelease::250::SANLock::(release) Cluster lock for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 successfully released >Thread-364::DEBUG::2012-11-29 15:07:40,297::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-364::DEBUG::2012-11-29 15:07:40,297::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-364::DEBUG::2012-11-29 15:07:40,305::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1947cca7ed0137c87d044cd956b46fa4fbb922e8'] >Thread-324::DEBUG::2012-11-29 15:07:40,305::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-324::INFO::2012-11-29 15:07:40,305::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 (id: 1) >Thread-324::DEBUG::2012-11-29 15:07:42,306::safelease::193::SANLock::(releaseHostId) Host id for domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 released successfully (id: 1) >Thread-364::DEBUG::2012-11-29 15:07:42,306::sp::1558::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b39553bd-b94c-42e1-8e06-40483d5f3c3f` stopped monitoring domain `4d25f33e-850f-4088-8f0b-e9cbc8276313` >Thread-364::DEBUG::2012-11-29 15:07:42,306::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-364::DEBUG::2012-11-29 15:07:42,307::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `4d25f33e-850f-4088-8f0b-e9cbc8276313` is done >Thread-364::DEBUG::2012-11-29 15:07:42,308::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=b39553bd-b94c-42e1-8e06-40483d5f3c3f', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Master', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=1947cca7ed0137c87d044cd956b46fa4fbb922e8'] >Thread-364::DEBUG::2012-11-29 15:07:42,309::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-364::DEBUG::2012-11-29 15:07:42,309::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-364::DEBUG::2012-11-29 15:07:42,309::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-364::DEBUG::2012-11-29 15:07:42,309::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-364::DEBUG::2012-11-29 15:07:42,309::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=04c600be38c73e2a5eaa69463b4424e696020996'] >Thread-364::DEBUG::2012-11-29 15:07:42,311::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-364::DEBUG::2012-11-29 15:07:42,311::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-364::DEBUG::2012-11-29 15:07:42,311::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-364::DEBUG::2012-11-29 15:07:42,313::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=04c600be38c73e2a5eaa69463b4424e696020996'] >Thread-364::DEBUG::2012-11-29 15:07:42,313::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-364::INFO::2012-11-29 15:07:42,313::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool b39553bd-b94c-42e1-8e06-40483d5f3c3f >Thread-364::INFO::2012-11-29 15:07:42,314::logUtils::39::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True >Thread-364::DEBUG::2012-11-29 15:07:42,314::task::1151::TaskManager.Task::(prepare) Task=`69f3fe26-5f61-4efb-b272-569c1de154e9`::finished: True >Thread-364::DEBUG::2012-11-29 15:07:42,314::task::568::TaskManager.Task::(_updateState) Task=`69f3fe26-5f61-4efb-b272-569c1de154e9`::moving from state preparing -> state finished >Thread-364::DEBUG::2012-11-29 15:07:42,314::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>, 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f': < ResourceRef 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', isValid: 'True' obj: 'None'>} >Thread-364::DEBUG::2012-11-29 15:07:42,314::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-364::DEBUG::2012-11-29 15:07:42,315::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-364::DEBUG::2012-11-29 15:07:42,315::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-364::DEBUG::2012-11-29 15:07:42,315::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-364::DEBUG::2012-11-29 15:07:42,315::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-364::DEBUG::2012-11-29 15:07:42,316::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' >Thread-364::DEBUG::2012-11-29 15:07:42,316::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' (0 active users) >Thread-364::DEBUG::2012-11-29 15:07:42,316::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f' is free, finding out if anyone is waiting for it. >Thread-364::DEBUG::2012-11-29 15:07:42,316::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b39553bd-b94c-42e1-8e06-40483d5f3c3f', Clearing records. >Thread-364::DEBUG::2012-11-29 15:07:42,316::task::957::TaskManager.Task::(_decref) Task=`69f3fe26-5f61-4efb-b272-569c1de154e9`::ref 0 aborting False >Thread-366::DEBUG::2012-11-29 15:07:42,343::task::568::TaskManager.Task::(_updateState) Task=`d82d544e-a997-45a4-9ea5-f23bb8fa8f1e`::moving from state init -> state preparing >Thread-366::INFO::2012-11-29 15:07:42,344::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-366::INFO::2012-11-29 15:07:42,344::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-366::DEBUG::2012-11-29 15:07:42,344::task::1151::TaskManager.Task::(prepare) Task=`d82d544e-a997-45a4-9ea5-f23bb8fa8f1e`::finished: {} >Thread-366::DEBUG::2012-11-29 15:07:42,344::task::568::TaskManager.Task::(_updateState) Task=`d82d544e-a997-45a4-9ea5-f23bb8fa8f1e`::moving from state preparing -> state finished >Thread-366::DEBUG::2012-11-29 15:07:42,344::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-366::DEBUG::2012-11-29 15:07:42,345::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-366::DEBUG::2012-11-29 15:07:42,345::task::957::TaskManager.Task::(_decref) Task=`d82d544e-a997-45a4-9ea5-f23bb8fa8f1e`::ref 0 aborting False >Thread-367::DEBUG::2012-11-29 15:07:42,358::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-367::DEBUG::2012-11-29 15:07:42,359::task::568::TaskManager.Task::(_updateState) Task=`2420e2f4-ec49-44b3-91ad-00439b12c2ea`::moving from state init -> state preparing >Thread-367::INFO::2012-11-29 15:07:42,359::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='4d25f33e-850f-4088-8f0b-e9cbc8276313', autoDetach=False, options=None) >Thread-367::DEBUG::2012-11-29 15:07:42,359::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-367::DEBUG::2012-11-29 15:07:42,359::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-367::DEBUG::2012-11-29 15:07:42,360::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-367::DEBUG::2012-11-29 15:07:42,373::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-367::DEBUG::2012-11-29 15:07:42,373::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-367::DEBUG::2012-11-29 15:07:42,376::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-367::DEBUG::2012-11-29 15:07:42,378::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-367::DEBUG::2012-11-29 15:07:42,380::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-367::DEBUG::2012-11-29 15:07:42,382::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-367::DEBUG::2012-11-29 15:07:42,384::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-367::DEBUG::2012-11-29 15:07:42,386::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-367::DEBUG::2012-11-29 15:07:42,388::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-367::DEBUG::2012-11-29 15:07:42,390::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-367::DEBUG::2012-11-29 15:07:44,393::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-367::DEBUG::2012-11-29 15:07:44,447::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-367::DEBUG::2012-11-29 15:07:44,448::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`f99f15b9-df84-4dec-903c-a5f5aa64d682`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-367::DEBUG::2012-11-29 15:07:44,448::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' for lock type 'exclusive' >Thread-367::DEBUG::2012-11-29 15:07:44,449::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free. Now locking as 'exclusive' (1 active user) >Thread-367::DEBUG::2012-11-29 15:07:44,449::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313`ReqID=`f99f15b9-df84-4dec-903c-a5f5aa64d682`::Granted request >Thread-367::DEBUG::2012-11-29 15:07:44,449::task::794::TaskManager.Task::(resourceAcquired) Task=`2420e2f4-ec49-44b3-91ad-00439b12c2ea`::_resourcesAcquired: Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313 (exclusive) >Thread-367::DEBUG::2012-11-29 15:07:44,449::task::957::TaskManager.Task::(_decref) Task=`2420e2f4-ec49-44b3-91ad-00439b12c2ea`::ref 1 aborting False >Thread-367::DEBUG::2012-11-29 15:07:44,463::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=04c600be38c73e2a5eaa69463b4424e696020996'] >Thread-367::DEBUG::2012-11-29 15:07:44,464::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-367::DEBUG::2012-11-29 15:07:44,464::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 4d25f33e-850f-4088-8f0b-e9cbc8276313' (cwd None) >Thread-367::DEBUG::2012-11-29 15:07:44,616::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found\n'; <rc> = 5 >Thread-367::WARNING::2012-11-29 15:07:44,616::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "4d25f33e-850f-4088-8f0b-e9cbc8276313" not found'] >Thread-367::DEBUG::2012-11-29 15:07:44,617::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-367::DEBUG::2012-11-29 15:07:44,619::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/_home_rest__test__domain/4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-367::DEBUG::2012-11-29 15:07:44,619::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-367::DEBUG::2012-11-29 15:07:44,620::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=RestDataDomain_LOCAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=RestDataCenter_LOCAL', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=/home/rest_test_domain', 'ROLE=Regular', 'SDUUID=4d25f33e-850f-4088-8f0b-e9cbc8276313', 'TYPE=LOCALFS', 'VERSION=3', '_SHA_CKSUM=04c600be38c73e2a5eaa69463b4424e696020996'] >Thread-367::DEBUG::2012-11-29 15:07:44,622::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-367::WARNING::2012-11-29 15:07:44,622::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_imageNS already registered >Thread-367::WARNING::2012-11-29 15:07:44,622::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4d25f33e-850f-4088-8f0b-e9cbc8276313_volumeNS already registered >Thread-367::INFO::2012-11-29 15:07:44,622::fileSD::404::Storage.StorageDomain::(format) Formatting domain 4d25f33e-850f-4088-8f0b-e9cbc8276313 >Thread-367::INFO::2012-11-29 15:07:44,625::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-367::DEBUG::2012-11-29 15:07:44,625::task::1151::TaskManager.Task::(prepare) Task=`2420e2f4-ec49-44b3-91ad-00439b12c2ea`::finished: None >Thread-367::DEBUG::2012-11-29 15:07:44,625::task::568::TaskManager.Task::(_updateState) Task=`2420e2f4-ec49-44b3-91ad-00439b12c2ea`::moving from state preparing -> state finished >Thread-367::DEBUG::2012-11-29 15:07:44,625::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313': < ResourceRef 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', isValid: 'True' obj: 'None'>} >Thread-367::DEBUG::2012-11-29 15:07:44,625::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-367::DEBUG::2012-11-29 15:07:44,626::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' >Thread-367::DEBUG::2012-11-29 15:07:44,626::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' (0 active users) >Thread-367::DEBUG::2012-11-29 15:07:44,626::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313' is free, finding out if anyone is waiting for it. >Thread-367::DEBUG::2012-11-29 15:07:44,626::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4d25f33e-850f-4088-8f0b-e9cbc8276313', Clearing records. >Thread-367::DEBUG::2012-11-29 15:07:44,627::task::957::TaskManager.Task::(_decref) Task=`2420e2f4-ec49-44b3-91ad-00439b12c2ea`::ref 0 aborting False >Thread-372::DEBUG::2012-11-29 15:07:44,663::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-372::DEBUG::2012-11-29 15:07:44,664::task::568::TaskManager.Task::(_updateState) Task=`9bd2f9e0-25ac-4c24-9a57-3d8b167cdb32`::moving from state init -> state preparing >Thread-372::INFO::2012-11-29 15:07:44,664::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=4, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '/home/rest_test_domain', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '372edb4d-9429-4285-88aa-859409c5e0e3', 'port': ''}], options=None) >Thread-372::DEBUG::2012-11-29 15:07:44,664::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-372::DEBUG::2012-11-29 15:07:44,664::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-372::DEBUG::2012-11-29 15:07:44,665::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-372::DEBUG::2012-11-29 15:07:44,665::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-372::DEBUG::2012-11-29 15:07:44,665::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-372::DEBUG::2012-11-29 15:07:44,679::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-372::DEBUG::2012-11-29 15:07:44,679::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-372::DEBUG::2012-11-29 15:07:44,681::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 15:07:44,683::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 15:07:44,685::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 15:07:44,687::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 15:07:44,689::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 15:07:44,691::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 15:07:44,693::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-372::DEBUG::2012-11-29 15:07:44,695::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-372::DEBUG::2012-11-29 15:07:46,698::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-372::DEBUG::2012-11-29 15:07:46,749::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-372::DEBUG::2012-11-29 15:07:46,749::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2012-11-29 15:07:46,750::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2012-11-29 15:07:46,750::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2012-11-29 15:07:46,750::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2012-11-29 15:07:46,750::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-372::DEBUG::2012-11-29 15:07:46,751::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-372::DEBUG::2012-11-29 15:07:46,751::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-372::INFO::2012-11-29 15:07:46,752::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-372::DEBUG::2012-11-29 15:07:46,752::task::1151::TaskManager.Task::(prepare) Task=`9bd2f9e0-25ac-4c24-9a57-3d8b167cdb32`::finished: {'statuslist': [{'status': 0, 'id': '372edb4d-9429-4285-88aa-859409c5e0e3'}]} >Thread-372::DEBUG::2012-11-29 15:07:46,752::task::568::TaskManager.Task::(_updateState) Task=`9bd2f9e0-25ac-4c24-9a57-3d8b167cdb32`::moving from state preparing -> state finished >Thread-372::DEBUG::2012-11-29 15:07:46,752::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-372::DEBUG::2012-11-29 15:07:46,752::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-372::DEBUG::2012-11-29 15:07:46,753::task::957::TaskManager.Task::(_decref) Task=`9bd2f9e0-25ac-4c24-9a57-3d8b167cdb32`::ref 0 aborting False >Thread-374::DEBUG::2012-11-29 15:07:46,850::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-374::DEBUG::2012-11-29 15:07:46,851::task::568::TaskManager.Task::(_updateState) Task=`4d7b3c65-eb4f-4a40-8b16-c4c7751e6ea4`::moving from state init -> state preparing >Thread-374::INFO::2012-11-29 15:07:46,851::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='b39553bd-b94c-42e1-8e06-40483d5f3c3f', hostID=1, scsiKey='b39553bd-b94c-42e1-8e06-40483d5f3c3f', remove=False, options=None) >Thread-374::WARNING::2012-11-29 15:07:46,851::hsm::1001::Storage.HSM::(disconnectStoragePool) disconnect sp: b39553bd-b94c-42e1-8e06-40483d5f3c3f failed. Known pools {} >Thread-374::INFO::2012-11-29 15:07:46,851::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-374::DEBUG::2012-11-29 15:07:46,852::task::1151::TaskManager.Task::(prepare) Task=`4d7b3c65-eb4f-4a40-8b16-c4c7751e6ea4`::finished: None >Thread-374::DEBUG::2012-11-29 15:07:46,852::task::568::TaskManager.Task::(_updateState) Task=`4d7b3c65-eb4f-4a40-8b16-c4c7751e6ea4`::moving from state preparing -> state finished >Thread-374::DEBUG::2012-11-29 15:07:46,852::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-374::DEBUG::2012-11-29 15:07:46,852::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-374::DEBUG::2012-11-29 15:07:46,852::task::957::TaskManager.Task::(_decref) Task=`4d7b3c65-eb4f-4a40-8b16-c4c7751e6ea4`::ref 0 aborting False >Thread-375::DEBUG::2012-11-29 15:07:48,484::task::568::TaskManager.Task::(_updateState) Task=`997e3348-c97d-408f-8149-e67898562572`::moving from state init -> state preparing >Thread-375::INFO::2012-11-29 15:07:48,485::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-375::INFO::2012-11-29 15:07:48,485::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-375::DEBUG::2012-11-29 15:07:48,485::task::1151::TaskManager.Task::(prepare) Task=`997e3348-c97d-408f-8149-e67898562572`::finished: {} >Thread-375::DEBUG::2012-11-29 15:07:48,485::task::568::TaskManager.Task::(_updateState) Task=`997e3348-c97d-408f-8149-e67898562572`::moving from state preparing -> state finished >Thread-375::DEBUG::2012-11-29 15:07:48,485::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-375::DEBUG::2012-11-29 15:07:48,485::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-375::DEBUG::2012-11-29 15:07:48,486::task::957::TaskManager.Task::(_decref) Task=`997e3348-c97d-408f-8149-e67898562572`::ref 0 aborting False >Thread-377::DEBUG::2012-11-29 15:07:59,077::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} flowID [4f5ec479] >Thread-377::DEBUG::2012-11-29 15:07:59,096::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.150', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-378::DEBUG::2012-11-29 15:08:00,587::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-378::DEBUG::2012-11-29 15:08:00,604::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.150', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-380::DEBUG::2012-11-29 15:08:02,715::task::568::TaskManager.Task::(_updateState) Task=`67909ce8-385a-4e6b-a4e7-fb301dc7ea5a`::moving from state init -> state preparing >Thread-380::INFO::2012-11-29 15:08:02,715::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-380::INFO::2012-11-29 15:08:02,716::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-380::DEBUG::2012-11-29 15:08:02,716::task::1151::TaskManager.Task::(prepare) Task=`67909ce8-385a-4e6b-a4e7-fb301dc7ea5a`::finished: {} >Thread-380::DEBUG::2012-11-29 15:08:02,716::task::568::TaskManager.Task::(_updateState) Task=`67909ce8-385a-4e6b-a4e7-fb301dc7ea5a`::moving from state preparing -> state finished >Thread-380::DEBUG::2012-11-29 15:08:02,716::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-380::DEBUG::2012-11-29 15:08:02,716::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-380::DEBUG::2012-11-29 15:08:02,716::task::957::TaskManager.Task::(_decref) Task=`67909ce8-385a-4e6b-a4e7-fb301dc7ea5a`::ref 0 aborting False >Thread-385::DEBUG::2012-11-29 15:08:09,843::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-385::DEBUG::2012-11-29 15:08:09,843::task::568::TaskManager.Task::(_updateState) Task=`2f783e07-f5de-458e-a927-5c8b2ffc5176`::moving from state init -> state preparing >Thread-385::INFO::2012-11-29 15:08:09,843::logUtils::37::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.148.12', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-385::DEBUG::2012-11-29 15:08:09,844::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.148.12:3260 --op=new' (cwd None) >Thread-385::DEBUG::2012-11-29 15:08:09,867::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-385::DEBUG::2012-11-29 15:08:09,868::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.148.12:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-385::DEBUG::2012-11-29 15:08:09,879::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = 'iscsiadm: Cannot modify node.startup. Invalid param name.\n'; <rc> = 7 >Thread-385::DEBUG::2012-11-29 15:08:09,879::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m iface' (cwd None) >Thread-385::DEBUG::2012-11-29 15:08:09,903::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-385::DEBUG::2012-11-29 15:08:09,903::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.148.12:3260 --discover' (cwd None) >Thread-385::DEBUG::2012-11-29 15:08:09,920::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-385::DEBUG::2012-11-29 15:08:09,920::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.148.12:3260 --op=delete' (cwd None) >Thread-385::DEBUG::2012-11-29 15:08:09,932::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-385::INFO::2012-11-29 15:08:09,932::logUtils::39::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.148.12:3260,2000 iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e'], 'targets': ['iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e']} >Thread-385::DEBUG::2012-11-29 15:08:09,932::task::1151::TaskManager.Task::(prepare) Task=`2f783e07-f5de-458e-a927-5c8b2ffc5176`::finished: {'fullTargets': ['10.35.148.12:3260,2000 iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e'], 'targets': ['iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e']} >Thread-385::DEBUG::2012-11-29 15:08:09,933::task::568::TaskManager.Task::(_updateState) Task=`2f783e07-f5de-458e-a927-5c8b2ffc5176`::moving from state preparing -> state finished >Thread-385::DEBUG::2012-11-29 15:08:09,933::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-385::DEBUG::2012-11-29 15:08:09,933::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-385::DEBUG::2012-11-29 15:08:09,933::task::957::TaskManager.Task::(_decref) Task=`2f783e07-f5de-458e-a927-5c8b2ffc5176`::ref 0 aborting False >Thread-386::DEBUG::2012-11-29 15:08:10,435::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-386::DEBUG::2012-11-29 15:08:10,436::task::568::TaskManager.Task::(_updateState) Task=`38e641c6-7240-4fde-ac51-3d01795f6937`::moving from state init -> state preparing >Thread-386::INFO::2012-11-29 15:08:10,436::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.148.12', 'iqn': 'iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-386::INFO::2012-11-29 15:08:10,436::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-386::DEBUG::2012-11-29 15:08:10,436::task::1151::TaskManager.Task::(prepare) Task=`38e641c6-7240-4fde-ac51-3d01795f6937`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-386::DEBUG::2012-11-29 15:08:10,437::task::568::TaskManager.Task::(_updateState) Task=`38e641c6-7240-4fde-ac51-3d01795f6937`::moving from state preparing -> state finished >Thread-386::DEBUG::2012-11-29 15:08:10,437::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-386::DEBUG::2012-11-29 15:08:10,437::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-386::DEBUG::2012-11-29 15:08:10,437::task::957::TaskManager.Task::(_decref) Task=`38e641c6-7240-4fde-ac51-3d01795f6937`::ref 0 aborting False >Thread-387::DEBUG::2012-11-29 15:08:10,472::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-387::DEBUG::2012-11-29 15:08:10,473::task::568::TaskManager.Task::(_updateState) Task=`5ffa8cb3-b0b8-49c2-85f5-7efde054200d`::moving from state init -> state preparing >Thread-387::INFO::2012-11-29 15:08:10,473::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.148.12', 'iqn': 'iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-387::DEBUG::2012-11-29 15:08:10,473::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e -I default -p 10.35.148.12:3260 --op=new' (cwd None) >Thread-387::DEBUG::2012-11-29 15:08:10,485::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-387::DEBUG::2012-11-29 15:08:10,486::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e -I default -p 10.35.148.12:3260 -l' (cwd None) >Thread-387::DEBUG::2012-11-29 15:08:10,498::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-387::DEBUG::2012-11-29 15:08:10,499::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e -I default -p 10.35.148.12:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-387::DEBUG::2012-11-29 15:08:10,510::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-387::INFO::2012-11-29 15:08:10,510::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-387::DEBUG::2012-11-29 15:08:10,511::task::1151::TaskManager.Task::(prepare) Task=`5ffa8cb3-b0b8-49c2-85f5-7efde054200d`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-387::DEBUG::2012-11-29 15:08:10,511::task::568::TaskManager.Task::(_updateState) Task=`5ffa8cb3-b0b8-49c2-85f5-7efde054200d`::moving from state preparing -> state finished >Thread-387::DEBUG::2012-11-29 15:08:10,511::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-387::DEBUG::2012-11-29 15:08:10,511::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-387::DEBUG::2012-11-29 15:08:10,511::task::957::TaskManager.Task::(_decref) Task=`5ffa8cb3-b0b8-49c2-85f5-7efde054200d`::ref 0 aborting False >Thread-389::DEBUG::2012-11-29 15:08:10,993::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-389::DEBUG::2012-11-29 15:08:10,993::task::568::TaskManager.Task::(_updateState) Task=`e425feb0-ab83-4265-9a04-199345554f26`::moving from state init -> state preparing >Thread-389::INFO::2012-11-29 15:08:10,994::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=0, options={}) >Thread-389::DEBUG::2012-11-29 15:08:10,994::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-389::DEBUG::2012-11-29 15:08:10,994::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-389::DEBUG::2012-11-29 15:08:10,994::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-389::DEBUG::2012-11-29 15:08:10,994::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-389::DEBUG::2012-11-29 15:08:10,995::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-389::DEBUG::2012-11-29 15:08:11,008::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-389::DEBUG::2012-11-29 15:08:11,008::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:11,010::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:11,012::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:11,014::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:11,016::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:11,018::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:11,020::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:11,022::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:11,024::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-390::DEBUG::2012-11-29 15:08:13,009::task::568::TaskManager.Task::(_updateState) Task=`261b5e46-ed22-4951-b88a-fd4a45e08f7f`::moving from state init -> state preparing >Thread-390::INFO::2012-11-29 15:08:13,009::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-390::INFO::2012-11-29 15:08:13,009::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-390::DEBUG::2012-11-29 15:08:13,009::task::1151::TaskManager.Task::(prepare) Task=`261b5e46-ed22-4951-b88a-fd4a45e08f7f`::finished: {} >Thread-390::DEBUG::2012-11-29 15:08:13,009::task::568::TaskManager.Task::(_updateState) Task=`261b5e46-ed22-4951-b88a-fd4a45e08f7f`::moving from state preparing -> state finished >Thread-390::DEBUG::2012-11-29 15:08:13,009::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-390::DEBUG::2012-11-29 15:08:13,010::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-390::DEBUG::2012-11-29 15:08:13,010::task::957::TaskManager.Task::(_decref) Task=`261b5e46-ed22-4951-b88a-fd4a45e08f7f`::ref 0 aborting False >Thread-389::DEBUG::2012-11-29 15:08:13,027::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-389::DEBUG::2012-11-29 15:08:13,079::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-389::DEBUG::2012-11-29 15:08:13,080::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-389::DEBUG::2012-11-29 15:08:13,080::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-389::DEBUG::2012-11-29 15:08:13,080::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-389::DEBUG::2012-11-29 15:08:13,081::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-389::DEBUG::2012-11-29 15:08:13,081::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-389::DEBUG::2012-11-29 15:08:13,081::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-389::DEBUG::2012-11-29 15:08:13,081::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-389::DEBUG::2012-11-29 15:08:13,082::lvm::334::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-389::DEBUG::2012-11-29 15:08:13,082::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-389::DEBUG::2012-11-29 15:08:13,233::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-389::DEBUG::2012-11-29 15:08:13,234::lvm::359::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:13,234::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-389::DEBUG::2012-11-29 15:08:13,238::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-389::ERROR::2012-11-29 15:08:13,238::supervdsmServer::80::SuperVdsm.ServerCallback::(wrapper) Error in getPathsStatus >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 78, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 135, in getPathsStatus > return _getPathsStatus() > File "/usr/share/vdsm/storage/devicemapper.py", line 179, in _getPathsStatus > devName, statusLine = statusLine.split(":", 1) >ValueError: need more than 1 value to unpack >Thread-389::ERROR::2012-11-29 15:08:13,246::task::833::TaskManager.Task::(_setError) Task=`e425feb0-ab83-4265-9a04-199345554f26`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 1755, in getDeviceList > devices = self._getDeviceList(storageType) > File "/usr/share/vdsm/storage/hsm.py", line 1787, in _getDeviceList > for dev in multipath.pathListIter(guids): > File "/usr/share/vdsm/storage/multipath.py", line 224, in pathListIter > pathStatuses = devicemapper.getPathsStatus() > File "/usr/share/vdsm/storage/devicemapper.py", line 189, in getPathsStatus > return getProxy().getPathsStatus() > File "/usr/share/vdsm/supervdsm.py", line 76, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 67, in <lambda> > **kwargs) > File "<string>", line 2, in getPathsStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >ValueError: need more than 1 value to unpack >Thread-389::DEBUG::2012-11-29 15:08:13,288::task::852::TaskManager.Task::(_run) Task=`e425feb0-ab83-4265-9a04-199345554f26`::Task._run: e425feb0-ab83-4265-9a04-199345554f26 (0,) {} failed - stopping task >Thread-389::DEBUG::2012-11-29 15:08:13,288::task::1177::TaskManager.Task::(stop) Task=`e425feb0-ab83-4265-9a04-199345554f26`::stopping in state preparing (force False) >Thread-389::DEBUG::2012-11-29 15:08:13,290::task::957::TaskManager.Task::(_decref) Task=`e425feb0-ab83-4265-9a04-199345554f26`::ref 1 aborting True >Thread-389::INFO::2012-11-29 15:08:13,290::task::1134::TaskManager.Task::(prepare) Task=`e425feb0-ab83-4265-9a04-199345554f26`::aborting: Task is aborted: u'need more than 1 value to unpack' - code 100 >Thread-389::DEBUG::2012-11-29 15:08:13,290::task::1139::TaskManager.Task::(prepare) Task=`e425feb0-ab83-4265-9a04-199345554f26`::Prepare: aborted: need more than 1 value to unpack >Thread-389::DEBUG::2012-11-29 15:08:13,290::task::957::TaskManager.Task::(_decref) Task=`e425feb0-ab83-4265-9a04-199345554f26`::ref 0 aborting True >Thread-389::DEBUG::2012-11-29 15:08:13,290::task::892::TaskManager.Task::(_doAbort) Task=`e425feb0-ab83-4265-9a04-199345554f26`::Task._doAbort: force False >Thread-389::DEBUG::2012-11-29 15:08:13,291::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-389::DEBUG::2012-11-29 15:08:13,291::task::568::TaskManager.Task::(_updateState) Task=`e425feb0-ab83-4265-9a04-199345554f26`::moving from state preparing -> state aborting >Thread-389::DEBUG::2012-11-29 15:08:13,291::task::523::TaskManager.Task::(__state_aborting) Task=`e425feb0-ab83-4265-9a04-199345554f26`::_aborting: recover policy none >Thread-389::DEBUG::2012-11-29 15:08:13,291::task::568::TaskManager.Task::(_updateState) Task=`e425feb0-ab83-4265-9a04-199345554f26`::moving from state aborting -> state failed >Thread-389::DEBUG::2012-11-29 15:08:13,291::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-389::DEBUG::2012-11-29 15:08:13,292::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-389::ERROR::2012-11-29 15:08:13,292::dispatcher::69::Storage.Dispatcher.Protect::(run) need more than 1 value to unpack >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 61, in run > result = ctask.prepare(self.func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 1142, in prepare > raise self.error >ValueError: need more than 1 value to unpack >Thread-392::DEBUG::2012-11-29 15:08:14,426::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-392::DEBUG::2012-11-29 15:08:14,426::task::568::TaskManager.Task::(_updateState) Task=`2b0ebde4-650f-48c7-a425-319fc9df2614`::moving from state init -> state preparing >Thread-392::INFO::2012-11-29 15:08:14,426::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.148.12', 'iqn': 'iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-392::INFO::2012-11-29 15:08:14,426::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-392::DEBUG::2012-11-29 15:08:14,427::task::1151::TaskManager.Task::(prepare) Task=`2b0ebde4-650f-48c7-a425-319fc9df2614`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-392::DEBUG::2012-11-29 15:08:14,427::task::568::TaskManager.Task::(_updateState) Task=`2b0ebde4-650f-48c7-a425-319fc9df2614`::moving from state preparing -> state finished >Thread-392::DEBUG::2012-11-29 15:08:14,427::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-392::DEBUG::2012-11-29 15:08:14,427::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-392::DEBUG::2012-11-29 15:08:14,427::task::957::TaskManager.Task::(_decref) Task=`2b0ebde4-650f-48c7-a425-319fc9df2614`::ref 0 aborting False >Thread-393::DEBUG::2012-11-29 15:08:14,455::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-393::DEBUG::2012-11-29 15:08:14,456::task::568::TaskManager.Task::(_updateState) Task=`bcfbaf87-66e5-4600-9ff2-bf52dc1de672`::moving from state init -> state preparing >Thread-393::INFO::2012-11-29 15:08:14,456::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.148.12', 'iqn': 'iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-393::DEBUG::2012-11-29 15:08:14,456::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e -I default -p 10.35.148.12:3260 --op=new' (cwd None) >Thread-393::DEBUG::2012-11-29 15:08:14,468::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-393::DEBUG::2012-11-29 15:08:14,469::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e -I default -p 10.35.148.12:3260 -l' (cwd None) >Thread-393::DEBUG::2012-11-29 15:08:14,481::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-393::DEBUG::2012-11-29 15:08:14,482::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-08.com.netapp:sn.1574937817:vf.af72f996-a4d9-11e1-a00b-00a0981c197e -I default -p 10.35.148.12:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-393::DEBUG::2012-11-29 15:08:14,493::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-393::INFO::2012-11-29 15:08:14,493::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-393::DEBUG::2012-11-29 15:08:14,493::task::1151::TaskManager.Task::(prepare) Task=`bcfbaf87-66e5-4600-9ff2-bf52dc1de672`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-393::DEBUG::2012-11-29 15:08:14,494::task::568::TaskManager.Task::(_updateState) Task=`bcfbaf87-66e5-4600-9ff2-bf52dc1de672`::moving from state preparing -> state finished >Thread-393::DEBUG::2012-11-29 15:08:14,494::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-393::DEBUG::2012-11-29 15:08:14,494::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-393::DEBUG::2012-11-29 15:08:14,494::task::957::TaskManager.Task::(_decref) Task=`bcfbaf87-66e5-4600-9ff2-bf52dc1de672`::ref 0 aborting False >Thread-394::DEBUG::2012-11-29 15:08:14,530::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-394::DEBUG::2012-11-29 15:08:14,531::task::568::TaskManager.Task::(_updateState) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::moving from state init -> state preparing >Thread-394::INFO::2012-11-29 15:08:14,531::logUtils::37::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-394::DEBUG::2012-11-29 15:08:14,531::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-394::DEBUG::2012-11-29 15:08:14,531::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-394::DEBUG::2012-11-29 15:08:14,531::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-394::DEBUG::2012-11-29 15:08:14,532::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-394::DEBUG::2012-11-29 15:08:14,532::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-394::DEBUG::2012-11-29 15:08:14,545::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-394::DEBUG::2012-11-29 15:08:14,546::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:14,547::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:14,550::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:14,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:14,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:14,556::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:14,558::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:14,560::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:14,562::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-394::DEBUG::2012-11-29 15:08:16,565::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-394::DEBUG::2012-11-29 15:08:16,607::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-394::DEBUG::2012-11-29 15:08:16,607::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-394::DEBUG::2012-11-29 15:08:16,608::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-394::DEBUG::2012-11-29 15:08:16,608::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-394::DEBUG::2012-11-29 15:08:16,608::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-394::DEBUG::2012-11-29 15:08:16,608::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-394::DEBUG::2012-11-29 15:08:16,609::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-394::DEBUG::2012-11-29 15:08:16,609::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-394::DEBUG::2012-11-29 15:08:16,609::lvm::334::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-394::DEBUG::2012-11-29 15:08:16,610::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-394::DEBUG::2012-11-29 15:08:16,761::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-394::DEBUG::2012-11-29 15:08:16,762::lvm::359::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:16,762::misc::83::Storage.Misc.excCmd::(<lambda>) '/sbin/dmsetup status' (cwd None) >MainProcess|Thread-394::DEBUG::2012-11-29 15:08:16,766::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >MainProcess|Thread-394::ERROR::2012-11-29 15:08:16,766::supervdsmServer::80::SuperVdsm.ServerCallback::(wrapper) Error in getPathsStatus >Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer.py", line 78, in wrapper > return func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer.py", line 135, in getPathsStatus > return _getPathsStatus() > File "/usr/share/vdsm/storage/devicemapper.py", line 179, in _getPathsStatus > devName, statusLine = statusLine.split(":", 1) >ValueError: need more than 1 value to unpack >Thread-394::ERROR::2012-11-29 15:08:16,766::task::833::TaskManager.Task::(_setError) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 1755, in getDeviceList > devices = self._getDeviceList(storageType) > File "/usr/share/vdsm/storage/hsm.py", line 1787, in _getDeviceList > for dev in multipath.pathListIter(guids): > File "/usr/share/vdsm/storage/multipath.py", line 224, in pathListIter > pathStatuses = devicemapper.getPathsStatus() > File "/usr/share/vdsm/storage/devicemapper.py", line 189, in getPathsStatus > return getProxy().getPathsStatus() > File "/usr/share/vdsm/supervdsm.py", line 76, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 67, in <lambda> > **kwargs) > File "<string>", line 2, in getPathsStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >ValueError: need more than 1 value to unpack >Thread-394::DEBUG::2012-11-29 15:08:16,767::task::852::TaskManager.Task::(_run) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::Task._run: 81fe4478-5ee7-4919-83ff-4d11f4aca539 (3,) {} failed - stopping task >Thread-394::DEBUG::2012-11-29 15:08:16,767::task::1177::TaskManager.Task::(stop) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::stopping in state preparing (force False) >Thread-394::DEBUG::2012-11-29 15:08:16,767::task::957::TaskManager.Task::(_decref) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::ref 1 aborting True >Thread-394::INFO::2012-11-29 15:08:16,768::task::1134::TaskManager.Task::(prepare) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::aborting: Task is aborted: u'need more than 1 value to unpack' - code 100 >Thread-394::DEBUG::2012-11-29 15:08:16,768::task::1139::TaskManager.Task::(prepare) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::Prepare: aborted: need more than 1 value to unpack >Thread-394::DEBUG::2012-11-29 15:08:16,768::task::957::TaskManager.Task::(_decref) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::ref 0 aborting True >Thread-394::DEBUG::2012-11-29 15:08:16,768::task::892::TaskManager.Task::(_doAbort) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::Task._doAbort: force False >Thread-394::DEBUG::2012-11-29 15:08:16,768::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-394::DEBUG::2012-11-29 15:08:16,769::task::568::TaskManager.Task::(_updateState) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::moving from state preparing -> state aborting >Thread-394::DEBUG::2012-11-29 15:08:16,769::task::523::TaskManager.Task::(__state_aborting) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::_aborting: recover policy none >Thread-394::DEBUG::2012-11-29 15:08:16,769::task::568::TaskManager.Task::(_updateState) Task=`81fe4478-5ee7-4919-83ff-4d11f4aca539`::moving from state aborting -> state failed >Thread-394::DEBUG::2012-11-29 15:08:16,769::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-394::DEBUG::2012-11-29 15:08:16,769::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-394::ERROR::2012-11-29 15:08:16,770::dispatcher::69::Storage.Dispatcher.Protect::(run) need more than 1 value to unpack >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 61, in run > result = ctask.prepare(self.func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 1142, in prepare > raise self.error >ValueError: need more than 1 value to unpack >Thread-398::DEBUG::2012-11-29 15:08:21,174::task::568::TaskManager.Task::(_updateState) Task=`823db69c-8b92-49a6-b1e2-bca0ad0cc713`::moving from state init -> state preparing >Thread-398::INFO::2012-11-29 15:08:21,174::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-398::INFO::2012-11-29 15:08:21,175::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-398::DEBUG::2012-11-29 15:08:21,175::task::1151::TaskManager.Task::(prepare) Task=`823db69c-8b92-49a6-b1e2-bca0ad0cc713`::finished: {} >Thread-398::DEBUG::2012-11-29 15:08:21,175::task::568::TaskManager.Task::(_updateState) Task=`823db69c-8b92-49a6-b1e2-bca0ad0cc713`::moving from state preparing -> state finished >Thread-398::DEBUG::2012-11-29 15:08:21,175::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-398::DEBUG::2012-11-29 15:08:21,175::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-398::DEBUG::2012-11-29 15:08:21,175::task::957::TaskManager.Task::(_decref) Task=`823db69c-8b92-49a6-b1e2-bca0ad0cc713`::ref 0 aborting False >Thread-400::DEBUG::2012-11-29 15:08:30,921::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} flowID [148bbf75] >Thread-400::DEBUG::2012-11-29 15:08:30,940::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.150', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-401::DEBUG::2012-11-29 15:08:31,275::BindingXMLRPC::903::vds::(wrapper) client [10.35.19.68]::call getCapabilities with () {} >Thread-401::DEBUG::2012-11-29 15:08:31,291::BindingXMLRPC::910::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e'}], 'FC': []}, 'packages2': {'kernel': {'release': '279.el6.x86_64', 'buildtime': 1339601076.0, 'version': '2.6.32'}, 'qemu-kvm-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}, 'spice-server': {'release': '3.el6', 'buildtime': 1353327832L, 'version': '0.12.0'}, 'vdsm': {'release': '1.0.el6', 'buildtime': 1353349266L, 'version': '4.10.2'}, 'libvirt': {'release': '9.el6', 'buildtime': 1353332831L, 'version': '0.10.2'}, 'qemu-img-rhev': {'release': '2.335.el6', 'buildtime': 1353335567L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5620 @ 2.40GHz', 'hooks': {}, 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged': True, 'gateway': '10.35.151.254', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '', 'cfg': {'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ports': ['eth0']}}, 'uuid': 'bbcfd2f5-d38a-4e8d-9e13-18c5adf69fe7', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'addr': '', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:26:6c:ff:cb:91', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:91', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'DHCP_HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'NM_CONTROLLED': 'no', 'HOSTNAME': 'cinteg02.ci.lab.tlv.redhat.com', 'MTU': '1500', 'HWADDR': '00:26:6C:FF:CB:90', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'UUID': '3ecfe663-8057-446c-a681-b6cd58f4830a'}, 'mtu': '1500', 'netmask': '', 'hwaddr': '00:26:6c:ff:cb:90', 'speed': 1000}}, 'software_revision': '1.0', 'clusterLevels': ['3.0', '3.1'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:cadadf20846e', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'], 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.10', 'memSize': '11901', 'cpuSpeed': '2400.150', 'cpuSockets': '1', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '', 'version_name': 'Snow Man', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.3.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.19.68'}} >Thread-403::DEBUG::2012-11-29 15:08:33,401::task::568::TaskManager.Task::(_updateState) Task=`4c46ca8a-21ad-4994-97aa-b5fce77c321f`::moving from state init -> state preparing >Thread-403::INFO::2012-11-29 15:08:33,401::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-403::INFO::2012-11-29 15:08:33,402::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-403::DEBUG::2012-11-29 15:08:33,402::task::1151::TaskManager.Task::(prepare) Task=`4c46ca8a-21ad-4994-97aa-b5fce77c321f`::finished: {} >Thread-403::DEBUG::2012-11-29 15:08:33,402::task::568::TaskManager.Task::(_updateState) Task=`4c46ca8a-21ad-4994-97aa-b5fce77c321f`::moving from state preparing -> state finished >Thread-403::DEBUG::2012-11-29 15:08:33,402::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-403::DEBUG::2012-11-29 15:08:33,402::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-403::DEBUG::2012-11-29 15:08:33,402::task::957::TaskManager.Task::(_decref) Task=`4c46ca8a-21ad-4994-97aa-b5fce77c321f`::ref 0 aborting False >Thread-409::DEBUG::2012-11-29 15:08:42,299::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-409::DEBUG::2012-11-29 15:08:42,299::task::568::TaskManager.Task::(_updateState) Task=`d1262177-a432-4b74-a0cf-1ff450576e80`::moving from state init -> state preparing >Thread-409::INFO::2012-11-29 15:08:42,299::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-409::INFO::2012-11-29 15:08:42,300::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-409::DEBUG::2012-11-29 15:08:42,300::task::1151::TaskManager.Task::(prepare) Task=`d1262177-a432-4b74-a0cf-1ff450576e80`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-409::DEBUG::2012-11-29 15:08:42,300::task::568::TaskManager.Task::(_updateState) Task=`d1262177-a432-4b74-a0cf-1ff450576e80`::moving from state preparing -> state finished >Thread-409::DEBUG::2012-11-29 15:08:42,300::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-409::DEBUG::2012-11-29 15:08:42,300::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-409::DEBUG::2012-11-29 15:08:42,300::task::957::TaskManager.Task::(_decref) Task=`d1262177-a432-4b74-a0cf-1ff450576e80`::ref 0 aborting False >Thread-410::DEBUG::2012-11-29 15:08:42,340::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-410::DEBUG::2012-11-29 15:08:42,341::task::568::TaskManager.Task::(_updateState) Task=`83cfb1ff-7262-4530-bb4a-43b2c1f43f56`::moving from state init -> state preparing >Thread-410::INFO::2012-11-29 15:08:42,341::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-410::DEBUG::2012-11-29 15:08:42,344::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990' (cwd None) >Thread-410::INFO::2012-11-29 15:08:42,477::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-410::DEBUG::2012-11-29 15:08:42,477::task::1151::TaskManager.Task::(prepare) Task=`83cfb1ff-7262-4530-bb4a-43b2c1f43f56`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-410::DEBUG::2012-11-29 15:08:42,477::task::568::TaskManager.Task::(_updateState) Task=`83cfb1ff-7262-4530-bb4a-43b2c1f43f56`::moving from state preparing -> state finished >Thread-410::DEBUG::2012-11-29 15:08:42,477::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-410::DEBUG::2012-11-29 15:08:42,478::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-410::DEBUG::2012-11-29 15:08:42,478::task::957::TaskManager.Task::(_decref) Task=`83cfb1ff-7262-4530-bb4a-43b2c1f43f56`::ref 0 aborting False >Thread-411::DEBUG::2012-11-29 15:08:42,524::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-411::DEBUG::2012-11-29 15:08:42,524::task::568::TaskManager.Task::(_updateState) Task=`178be215-7066-4f95-8a16-fc1efb5d036a`::moving from state init -> state preparing >Thread-411::INFO::2012-11-29 15:08:42,525::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', options=None) >Thread-411::DEBUG::2012-11-29 15:08:42,525::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-411::DEBUG::2012-11-29 15:08:42,525::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-411::DEBUG::2012-11-29 15:08:42,525::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-411::DEBUG::2012-11-29 15:08:42,525::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-411::DEBUG::2012-11-29 15:08:42,526::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-411::DEBUG::2012-11-29 15:08:42,540::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-411::DEBUG::2012-11-29 15:08:42,540::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-411::DEBUG::2012-11-29 15:08:42,542::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-411::DEBUG::2012-11-29 15:08:42,544::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-411::DEBUG::2012-11-29 15:08:42,546::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-411::DEBUG::2012-11-29 15:08:42,548::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-411::DEBUG::2012-11-29 15:08:42,550::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-411::DEBUG::2012-11-29 15:08:42,552::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-411::DEBUG::2012-11-29 15:08:42,554::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-411::DEBUG::2012-11-29 15:08:42,556::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-412::DEBUG::2012-11-29 15:08:43,603::task::568::TaskManager.Task::(_updateState) Task=`47dc3683-4b86-40d7-8a00-379d8c253202`::moving from state init -> state preparing >Thread-412::INFO::2012-11-29 15:08:43,603::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-412::INFO::2012-11-29 15:08:43,603::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-412::DEBUG::2012-11-29 15:08:43,603::task::1151::TaskManager.Task::(prepare) Task=`47dc3683-4b86-40d7-8a00-379d8c253202`::finished: {} >Thread-412::DEBUG::2012-11-29 15:08:43,603::task::568::TaskManager.Task::(_updateState) Task=`47dc3683-4b86-40d7-8a00-379d8c253202`::moving from state preparing -> state finished >Thread-412::DEBUG::2012-11-29 15:08:43,604::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-412::DEBUG::2012-11-29 15:08:43,604::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-412::DEBUG::2012-11-29 15:08:43,604::task::957::TaskManager.Task::(_decref) Task=`47dc3683-4b86-40d7-8a00-379d8c253202`::ref 0 aborting False >Thread-411::DEBUG::2012-11-29 15:08:44,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-411::DEBUG::2012-11-29 15:08:44,617::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-411::DEBUG::2012-11-29 15:08:44,618::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-411::DEBUG::2012-11-29 15:08:44,618::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-411::DEBUG::2012-11-29 15:08:44,618::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-411::DEBUG::2012-11-29 15:08:44,618::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-411::DEBUG::2012-11-29 15:08:44,619::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-411::DEBUG::2012-11-29 15:08:44,619::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-411::DEBUG::2012-11-29 15:08:44,619::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-411::DEBUG::2012-11-29 15:08:44,619::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-411::DEBUG::2012-11-29 15:08:44,620::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-411::DEBUG::2012-11-29 15:08:44,769::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-411::DEBUG::2012-11-29 15:08:44,769::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-411::INFO::2012-11-29 15:08:44,835::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-411::DEBUG::2012-11-29 15:08:44,836::task::1151::TaskManager.Task::(prepare) Task=`178be215-7066-4f95-8a16-fc1efb5d036a`::finished: {'domlist': []} >Thread-411::DEBUG::2012-11-29 15:08:44,836::task::568::TaskManager.Task::(_updateState) Task=`178be215-7066-4f95-8a16-fc1efb5d036a`::moving from state preparing -> state finished >Thread-411::DEBUG::2012-11-29 15:08:44,836::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-411::DEBUG::2012-11-29 15:08:44,836::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-411::DEBUG::2012-11-29 15:08:44,837::task::957::TaskManager.Task::(_decref) Task=`178be215-7066-4f95-8a16-fc1efb5d036a`::ref 0 aborting False >Thread-415::DEBUG::2012-11-29 15:08:44,924::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-415::DEBUG::2012-11-29 15:08:44,924::task::568::TaskManager.Task::(_updateState) Task=`b6ca6672-2354-4342-b8e3-93fba4917fe6`::moving from state init -> state preparing >Thread-415::INFO::2012-11-29 15:08:44,925::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', domainName='DataDomainRest', typeSpecificArg='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', domClass=1, domVersion='3', options=None) >Thread-415::DEBUG::2012-11-29 15:08:44,925::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-415::DEBUG::2012-11-29 15:08:44,926::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-415::DEBUG::2012-11-29 15:08:45,076::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-415::WARNING::2012-11-29 15:08:45,077::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-415::DEBUG::2012-11-29 15:08:45,078::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-415::INFO::2012-11-29 15:08:45,080::nfsSD::68::Storage.StorageDomain::(create) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 domainName=DataDomainRest remotePath=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990 domClass=1 >Thread-415::DEBUG::2012-11-29 15:08:45,224::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-415::DEBUG::2012-11-29 15:08:45,225::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-415::WARNING::2012-11-29 15:08:45,225::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-415::DEBUG::2012-11-29 15:08:45,226::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-415::DEBUG::2012-11-29 15:08:45,226::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-415::DEBUG::2012-11-29 15:08:45,226::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f0ac85a6fdda520e904f861bb572bbd7f77765a'] >Thread-415::DEBUG::2012-11-29 15:08:45,230::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-415::DEBUG::2012-11-29 15:08:45,231::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-415::DEBUG::2012-11-29 15:08:45,231::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-415::DEBUG::2012-11-29 15:08:45,234::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f0ac85a6fdda520e904f861bb572bbd7f77765a'] >Thread-415::DEBUG::2012-11-29 15:08:45,236::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-415::DEBUG::2012-11-29 15:08:45,236::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS' >Thread-415::DEBUG::2012-11-29 15:08:45,237::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS' >Thread-415::DEBUG::2012-11-29 15:08:45,274::sd::396::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-415::INFO::2012-11-29 15:08:45,274::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-415::DEBUG::2012-11-29 15:08:45,275::task::1151::TaskManager.Task::(prepare) Task=`b6ca6672-2354-4342-b8e3-93fba4917fe6`::finished: None >Thread-415::DEBUG::2012-11-29 15:08:45,275::task::568::TaskManager.Task::(_updateState) Task=`b6ca6672-2354-4342-b8e3-93fba4917fe6`::moving from state preparing -> state finished >Thread-415::DEBUG::2012-11-29 15:08:45,275::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-415::DEBUG::2012-11-29 15:08:45,275::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-415::DEBUG::2012-11-29 15:08:45,275::task::957::TaskManager.Task::(_decref) Task=`b6ca6672-2354-4342-b8e3-93fba4917fe6`::ref 0 aborting False >Thread-417::DEBUG::2012-11-29 15:08:45,303::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-417::DEBUG::2012-11-29 15:08:45,304::task::568::TaskManager.Task::(_updateState) Task=`090ab98a-18df-48d5-b34c-1eff4f63ffef`::moving from state init -> state preparing >Thread-417::INFO::2012-11-29 15:08:45,304::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', options=None) >Thread-417::DEBUG::2012-11-29 15:08:45,304::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`3b6b0dc0-9efe-4f08-a565-d4ad69cc0600`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-417::DEBUG::2012-11-29 15:08:45,304::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'shared' >Thread-417::DEBUG::2012-11-29 15:08:45,305::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'shared' (1 active user) >Thread-417::DEBUG::2012-11-29 15:08:45,305::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`3b6b0dc0-9efe-4f08-a565-d4ad69cc0600`::Granted request >Thread-417::DEBUG::2012-11-29 15:08:45,305::task::794::TaskManager.Task::(resourceAcquired) Task=`090ab98a-18df-48d5-b34c-1eff4f63ffef`::_resourcesAcquired: Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (shared) >Thread-417::DEBUG::2012-11-29 15:08:45,305::task::957::TaskManager.Task::(_decref) Task=`090ab98a-18df-48d5-b34c-1eff4f63ffef`::ref 1 aborting False >Thread-417::INFO::2012-11-29 15:08:45,307::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861059153920', 'disktotal': '861059153920', 'mdafree': 0}} >Thread-417::DEBUG::2012-11-29 15:08:45,307::task::1151::TaskManager.Task::(prepare) Task=`090ab98a-18df-48d5-b34c-1eff4f63ffef`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861059153920', 'disktotal': '861059153920', 'mdafree': 0}} >Thread-417::DEBUG::2012-11-29 15:08:45,307::task::568::TaskManager.Task::(_updateState) Task=`090ab98a-18df-48d5-b34c-1eff4f63ffef`::moving from state preparing -> state finished >Thread-417::DEBUG::2012-11-29 15:08:45,307::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1': < ResourceRef 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', isValid: 'True' obj: 'None'>} >Thread-417::DEBUG::2012-11-29 15:08:45,307::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-417::DEBUG::2012-11-29 15:08:45,308::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >Thread-417::DEBUG::2012-11-29 15:08:45,308::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >Thread-417::DEBUG::2012-11-29 15:08:45,308::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >Thread-417::DEBUG::2012-11-29 15:08:45,308::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >Thread-417::DEBUG::2012-11-29 15:08:45,308::task::957::TaskManager.Task::(_decref) Task=`090ab98a-18df-48d5-b34c-1eff4f63ffef`::ref 0 aborting False >Thread-419::DEBUG::2012-11-29 15:08:46,623::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-419::DEBUG::2012-11-29 15:08:46,624::task::568::TaskManager.Task::(_updateState) Task=`bf9d1f6d-1e7f-433a-bcb0-1e7cf0558e3a`::moving from state init -> state preparing >Thread-419::INFO::2012-11-29 15:08:46,624::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-419::INFO::2012-11-29 15:08:46,624::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-419::DEBUG::2012-11-29 15:08:46,624::task::1151::TaskManager.Task::(prepare) Task=`bf9d1f6d-1e7f-433a-bcb0-1e7cf0558e3a`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-419::DEBUG::2012-11-29 15:08:46,624::task::568::TaskManager.Task::(_updateState) Task=`bf9d1f6d-1e7f-433a-bcb0-1e7cf0558e3a`::moving from state preparing -> state finished >Thread-419::DEBUG::2012-11-29 15:08:46,625::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-419::DEBUG::2012-11-29 15:08:46,625::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-419::DEBUG::2012-11-29 15:08:46,625::task::957::TaskManager.Task::(_decref) Task=`bf9d1f6d-1e7f-433a-bcb0-1e7cf0558e3a`::ref 0 aborting False >Thread-420::DEBUG::2012-11-29 15:08:46,647::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-420::DEBUG::2012-11-29 15:08:46,648::task::568::TaskManager.Task::(_updateState) Task=`80ef6875-7019-466e-8480-f2abc696a0a3`::moving from state init -> state preparing >Thread-420::INFO::2012-11-29 15:08:46,648::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-420::INFO::2012-11-29 15:08:46,650::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-420::DEBUG::2012-11-29 15:08:46,650::task::1151::TaskManager.Task::(prepare) Task=`80ef6875-7019-466e-8480-f2abc696a0a3`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-420::DEBUG::2012-11-29 15:08:46,650::task::568::TaskManager.Task::(_updateState) Task=`80ef6875-7019-466e-8480-f2abc696a0a3`::moving from state preparing -> state finished >Thread-420::DEBUG::2012-11-29 15:08:46,650::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-420::DEBUG::2012-11-29 15:08:46,650::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-420::DEBUG::2012-11-29 15:08:46,651::task::957::TaskManager.Task::(_decref) Task=`80ef6875-7019-466e-8480-f2abc696a0a3`::ref 0 aborting False >Thread-421::DEBUG::2012-11-29 15:08:46,672::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-421::DEBUG::2012-11-29 15:08:46,672::task::568::TaskManager.Task::(_updateState) Task=`ae264c5c-8abe-4932-bc3e-2228850d3b6e`::moving from state init -> state preparing >Thread-421::INFO::2012-11-29 15:08:46,672::logUtils::37::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', poolName='DefaultRest', masterDom='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', domList=['646a3b8e-d5dd-4bf7-be3d-384526eabdd1'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-421::INFO::2012-11-29 15:08:46,672::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-421::DEBUG::2012-11-29 15:08:46,675::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f0ac85a6fdda520e904f861bb572bbd7f77765a'] >Thread-421::DEBUG::2012-11-29 15:08:46,676::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`28023291-4cc9-4a44-a2db-87603b974762`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-421::DEBUG::2012-11-29 15:08:46,676::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-421::DEBUG::2012-11-29 15:08:46,676::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-421::DEBUG::2012-11-29 15:08:46,676::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`28023291-4cc9-4a44-a2db-87603b974762`::Granted request >Thread-421::DEBUG::2012-11-29 15:08:46,676::task::794::TaskManager.Task::(resourceAcquired) Task=`ae264c5c-8abe-4932-bc3e-2228850d3b6e`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-421::DEBUG::2012-11-29 15:08:46,677::task::957::TaskManager.Task::(_decref) Task=`ae264c5c-8abe-4932-bc3e-2228850d3b6e`::ref 1 aborting False >Thread-421::DEBUG::2012-11-29 15:08:46,677::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`81ae77e1-9ee8-4d21-8320-10185d47fb78`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-421::DEBUG::2012-11-29 15:08:46,677::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'exclusive' >Thread-421::DEBUG::2012-11-29 15:08:46,677::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'exclusive' (1 active user) >Thread-421::DEBUG::2012-11-29 15:08:46,677::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`81ae77e1-9ee8-4d21-8320-10185d47fb78`::Granted request >Thread-421::DEBUG::2012-11-29 15:08:46,678::task::794::TaskManager.Task::(resourceAcquired) Task=`ae264c5c-8abe-4932-bc3e-2228850d3b6e`::_resourcesAcquired: Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (exclusive) >Thread-421::DEBUG::2012-11-29 15:08:46,678::task::957::TaskManager.Task::(_decref) Task=`ae264c5c-8abe-4932-bc3e-2228850d3b6e`::ref 1 aborting False >Thread-421::INFO::2012-11-29 15:08:46,678::sp::544::Storage.StoragePool::(create) spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 poolName=DefaultRest master_sd=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 domList=['646a3b8e-d5dd-4bf7-be3d-384526eabdd1'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-421::INFO::2012-11-29 15:08:46,678::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-421::DEBUG::2012-11-29 15:08:46,681::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f0ac85a6fdda520e904f861bb572bbd7f77765a'] >Thread-421::DEBUG::2012-11-29 15:08:46,683::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2f0ac85a6fdda520e904f861bb572bbd7f77765a'] >Thread-421::DEBUG::2012-11-29 15:08:46,683::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-421::DEBUG::2012-11-29 15:08:46,683::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-421::DEBUG::2012-11-29 15:08:46,684::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=80032404db6c16f8c6cbfc049e1b53a7315bee2e'] >Thread-421::DEBUG::2012-11-29 15:08:46,687::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-421::INFO::2012-11-29 15:08:46,687::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 250) >Thread-425::DEBUG::2012-11-29 15:08:53,800::task::568::TaskManager.Task::(_updateState) Task=`01896971-b7d8-4cb5-93b6-9324fbbb0a3d`::moving from state init -> state preparing >Thread-425::INFO::2012-11-29 15:08:53,801::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-425::INFO::2012-11-29 15:08:53,801::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-425::DEBUG::2012-11-29 15:08:53,801::task::1151::TaskManager.Task::(prepare) Task=`01896971-b7d8-4cb5-93b6-9324fbbb0a3d`::finished: {} >Thread-425::DEBUG::2012-11-29 15:08:53,801::task::568::TaskManager.Task::(_updateState) Task=`01896971-b7d8-4cb5-93b6-9324fbbb0a3d`::moving from state preparing -> state finished >Thread-425::DEBUG::2012-11-29 15:08:53,801::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-425::DEBUG::2012-11-29 15:08:53,801::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-425::DEBUG::2012-11-29 15:08:53,802::task::957::TaskManager.Task::(_decref) Task=`01896971-b7d8-4cb5-93b6-9324fbbb0a3d`::ref 0 aborting False >Thread-431::DEBUG::2012-11-29 15:09:03,993::task::568::TaskManager.Task::(_updateState) Task=`8d821def-8b7f-4c7a-a27a-dffecf2da3f8`::moving from state init -> state preparing >Thread-431::INFO::2012-11-29 15:09:03,994::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-431::INFO::2012-11-29 15:09:03,994::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-431::DEBUG::2012-11-29 15:09:03,994::task::1151::TaskManager.Task::(prepare) Task=`8d821def-8b7f-4c7a-a27a-dffecf2da3f8`::finished: {} >Thread-431::DEBUG::2012-11-29 15:09:03,994::task::568::TaskManager.Task::(_updateState) Task=`8d821def-8b7f-4c7a-a27a-dffecf2da3f8`::moving from state preparing -> state finished >Thread-431::DEBUG::2012-11-29 15:09:03,994::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-431::DEBUG::2012-11-29 15:09:03,994::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-431::DEBUG::2012-11-29 15:09:03,994::task::957::TaskManager.Task::(_decref) Task=`8d821def-8b7f-4c7a-a27a-dffecf2da3f8`::ref 0 aborting False >Thread-421::DEBUG::2012-11-29 15:09:07,691::safelease::178::SANLock::(acquireHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully acquired (id: 250) >Thread-421::INFO::2012-11-29 15:09:07,691::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 250) >Thread-421::DEBUG::2012-11-29 15:09:07,725::safelease::235::SANLock::(acquire) Cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully acquired (id: 250) >Thread-421::INFO::2012-11-29 15:09:07,726::sp::708::Storage.StoragePool::(createMaster) setting master domain for spUUID 78cd442d-b34f-452c-9bc5-0b69929d8a93 on sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-421::DEBUG::2012-11-29 15:09:07,726::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-421::DEBUG::2012-11-29 15:09:07,726::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-421::DEBUG::2012-11-29 15:09:07,729::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=80032404db6c16f8c6cbfc049e1b53a7315bee2e'] >Thread-421::DEBUG::2012-11-29 15:09:07,729::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-421::DEBUG::2012-11-29 15:09:07,729::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-421::DEBUG::2012-11-29 15:09:07,729::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-421::DEBUG::2012-11-29 15:09:07,730::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-421::DEBUG::2012-11-29 15:09:07,730::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf69f07a8cd2dd01dbf3e7bb46d1789c13fd32f2'] >Thread-421::DEBUG::2012-11-29 15:09:07,733::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-421::DEBUG::2012-11-29 15:09:07,733::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-421::DEBUG::2012-11-29 15:09:07,733::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-421::DEBUG::2012-11-29 15:09:07,734::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-421::DEBUG::2012-11-29 15:09:07,737::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf69f07a8cd2dd01dbf3e7bb46d1789c13fd32f2'] >Thread-434::DEBUG::2012-11-29 15:09:07,737::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-421::DEBUG::2012-11-29 15:09:07,737::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` started monitoring domain `646a3b8e-d5dd-4bf7-be3d-384526eabdd1` >Thread-421::DEBUG::2012-11-29 15:09:07,738::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-421::WARNING::2012-11-29 15:09:07,739::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-421::DEBUG::2012-11-29 15:09:07,740::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-421::DEBUG::2012-11-29 15:09:07,741::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-421::DEBUG::2012-11-29 15:09:07,888::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-421::DEBUG::2012-11-29 15:09:07,888::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-421::INFO::2012-11-29 15:09:07,891::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-421::INFO::2012-11-29 15:09:07,891::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-421::INFO::2012-11-29 15:09:07,892::safelease::239::SANLock::(release) Releasing cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-421::DEBUG::2012-11-29 15:09:07,893::safelease::250::SANLock::(release) Cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully released >Thread-421::INFO::2012-11-29 15:09:07,893::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 250) >Thread-421::DEBUG::2012-11-29 15:09:09,894::safelease::193::SANLock::(releaseHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 released successfully (id: 250) >Thread-434::DEBUG::2012-11-29 15:09:09,894::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-434::INFO::2012-11-29 15:09:09,895::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 250) >Thread-434::DEBUG::2012-11-29 15:09:09,895::safelease::193::SANLock::(releaseHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 released successfully (id: 250) >Thread-421::INFO::2012-11-29 15:09:09,895::logUtils::39::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-421::DEBUG::2012-11-29 15:09:09,895::task::1151::TaskManager.Task::(prepare) Task=`ae264c5c-8abe-4932-bc3e-2228850d3b6e`::finished: True >Thread-421::DEBUG::2012-11-29 15:09:09,896::task::568::TaskManager.Task::(_updateState) Task=`ae264c5c-8abe-4932-bc3e-2228850d3b6e`::moving from state preparing -> state finished >Thread-421::DEBUG::2012-11-29 15:09:09,896::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1': < ResourceRef 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', isValid: 'True' obj: 'None'>} >Thread-421::DEBUG::2012-11-29 15:09:09,896::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-421::DEBUG::2012-11-29 15:09:09,896::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-421::DEBUG::2012-11-29 15:09:09,896::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-421::DEBUG::2012-11-29 15:09:09,897::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-421::DEBUG::2012-11-29 15:09:09,897::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-421::DEBUG::2012-11-29 15:09:09,897::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >Thread-421::DEBUG::2012-11-29 15:09:09,897::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >Thread-421::DEBUG::2012-11-29 15:09:09,897::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >Thread-421::DEBUG::2012-11-29 15:09:09,898::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >Thread-421::DEBUG::2012-11-29 15:09:09,898::task::957::TaskManager.Task::(_decref) Task=`ae264c5c-8abe-4932-bc3e-2228850d3b6e`::ref 0 aborting False >Thread-437::DEBUG::2012-11-29 15:09:09,976::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-437::DEBUG::2012-11-29 15:09:09,976::task::568::TaskManager.Task::(_updateState) Task=`5447be4d-4db8-4ee7-8d09-9a15fd30e2f5`::moving from state init -> state preparing >Thread-437::INFO::2012-11-29 15:09:09,976::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-437::INFO::2012-11-29 15:09:09,977::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-437::DEBUG::2012-11-29 15:09:09,977::task::1151::TaskManager.Task::(prepare) Task=`5447be4d-4db8-4ee7-8d09-9a15fd30e2f5`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-437::DEBUG::2012-11-29 15:09:09,977::task::568::TaskManager.Task::(_updateState) Task=`5447be4d-4db8-4ee7-8d09-9a15fd30e2f5`::moving from state preparing -> state finished >Thread-437::DEBUG::2012-11-29 15:09:09,977::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-437::DEBUG::2012-11-29 15:09:09,977::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-437::DEBUG::2012-11-29 15:09:09,977::task::957::TaskManager.Task::(_decref) Task=`5447be4d-4db8-4ee7-8d09-9a15fd30e2f5`::ref 0 aborting False >Thread-438::DEBUG::2012-11-29 15:09:10,019::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-438::DEBUG::2012-11-29 15:09:10,020::task::568::TaskManager.Task::(_updateState) Task=`e6422769-a7d7-4470-b5ef-ae7216f3c9f7`::moving from state init -> state preparing >Thread-438::INFO::2012-11-29 15:09:10,020::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-438::INFO::2012-11-29 15:09:10,022::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-438::DEBUG::2012-11-29 15:09:10,022::task::1151::TaskManager.Task::(prepare) Task=`e6422769-a7d7-4470-b5ef-ae7216f3c9f7`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-438::DEBUG::2012-11-29 15:09:10,022::task::568::TaskManager.Task::(_updateState) Task=`e6422769-a7d7-4470-b5ef-ae7216f3c9f7`::moving from state preparing -> state finished >Thread-438::DEBUG::2012-11-29 15:09:10,022::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-438::DEBUG::2012-11-29 15:09:10,022::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-438::DEBUG::2012-11-29 15:09:10,023::task::957::TaskManager.Task::(_decref) Task=`e6422769-a7d7-4470-b5ef-ae7216f3c9f7`::ref 0 aborting False >Thread-439::DEBUG::2012-11-29 15:09:10,070::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-439::DEBUG::2012-11-29 15:09:10,070::task::568::TaskManager.Task::(_updateState) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::moving from state init -> state preparing >Thread-439::INFO::2012-11-29 15:09:10,071::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-439::ERROR::2012-11-29 15:09:10,071::task::833::TaskManager.Task::(_setError) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 840, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 38, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 597, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 310, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('78cd442d-b34f-452c-9bc5-0b69929d8a93',) >Thread-439::DEBUG::2012-11-29 15:09:10,071::task::852::TaskManager.Task::(_run) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::Task._run: 1561bf6c-2322-4821-a1e5-502455eb6c80 ('78cd442d-b34f-452c-9bc5-0b69929d8a93',) {} failed - stopping task >Thread-439::DEBUG::2012-11-29 15:09:10,072::task::1177::TaskManager.Task::(stop) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::stopping in state preparing (force False) >Thread-439::DEBUG::2012-11-29 15:09:10,072::task::957::TaskManager.Task::(_decref) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::ref 1 aborting True >Thread-439::INFO::2012-11-29 15:09:10,072::task::1134::TaskManager.Task::(prepare) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-439::DEBUG::2012-11-29 15:09:10,072::task::1139::TaskManager.Task::(prepare) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::Prepare: aborted: Unknown pool id, pool not connected >Thread-439::DEBUG::2012-11-29 15:09:10,072::task::957::TaskManager.Task::(_decref) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::ref 0 aborting True >Thread-439::DEBUG::2012-11-29 15:09:10,072::task::892::TaskManager.Task::(_doAbort) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::Task._doAbort: force False >Thread-439::DEBUG::2012-11-29 15:09:10,073::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-439::DEBUG::2012-11-29 15:09:10,073::task::568::TaskManager.Task::(_updateState) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::moving from state preparing -> state aborting >Thread-439::DEBUG::2012-11-29 15:09:10,073::task::523::TaskManager.Task::(__state_aborting) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::_aborting: recover policy none >Thread-439::DEBUG::2012-11-29 15:09:10,073::task::568::TaskManager.Task::(_updateState) Task=`1561bf6c-2322-4821-a1e5-502455eb6c80`::moving from state aborting -> state failed >Thread-439::DEBUG::2012-11-29 15:09:10,073::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-439::DEBUG::2012-11-29 15:09:10,073::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-439::ERROR::2012-11-29 15:09:10,074::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('78cd442d-b34f-452c-9bc5-0b69929d8a93',)", 'code': 309}} >Thread-440::DEBUG::2012-11-29 15:09:10,099::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-440::DEBUG::2012-11-29 15:09:10,099::task::568::TaskManager.Task::(_updateState) Task=`e2038e4d-e8b2-4609-b4ae-1d6a7c9076ee`::moving from state init -> state preparing >Thread-440::INFO::2012-11-29 15:09:10,099::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', hostID=1, scsiKey='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-440::DEBUG::2012-11-29 15:09:10,099::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`347329a3-4681-4024-9378-bc0267b9ef69`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-440::DEBUG::2012-11-29 15:09:10,100::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-440::DEBUG::2012-11-29 15:09:10,100::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-440::DEBUG::2012-11-29 15:09:10,100::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`347329a3-4681-4024-9378-bc0267b9ef69`::Granted request >Thread-440::INFO::2012-11-29 15:09:10,100::sp::628::Storage.StoragePool::(connect) Connect host #1 to the storage pool 78cd442d-b34f-452c-9bc5-0b69929d8a93 with master domain: 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (ver = 1) >Thread-440::DEBUG::2012-11-29 15:09:10,101::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:10,101::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:10,102::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:10,102::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:10,102::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:10,103::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:10,103::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-440::DEBUG::2012-11-29 15:09:10,103::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-440::DEBUG::2012-11-29 15:09:10,103::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-440::DEBUG::2012-11-29 15:09:10,103::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-440::DEBUG::2012-11-29 15:09:10,104::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-440::DEBUG::2012-11-29 15:09:10,117::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-440::DEBUG::2012-11-29 15:09:10,118::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-440::DEBUG::2012-11-29 15:09:10,120::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-440::DEBUG::2012-11-29 15:09:10,122::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-440::DEBUG::2012-11-29 15:09:10,124::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-440::DEBUG::2012-11-29 15:09:10,126::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-440::DEBUG::2012-11-29 15:09:10,128::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-440::DEBUG::2012-11-29 15:09:10,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-440::DEBUG::2012-11-29 15:09:10,132::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-440::DEBUG::2012-11-29 15:09:10,134::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-440::DEBUG::2012-11-29 15:09:12,137::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-440::DEBUG::2012-11-29 15:09:12,193::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-440::DEBUG::2012-11-29 15:09:12,194::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,194::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,195::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,195::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,195::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,196::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,196::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-440::DEBUG::2012-11-29 15:09:12,196::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,197::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-440::DEBUG::2012-11-29 15:09:12,354::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-440::WARNING::2012-11-29 15:09:12,355::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-440::DEBUG::2012-11-29 15:09:12,355::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,359::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-440::DEBUG::2012-11-29 15:09:12,360::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-440::DEBUG::2012-11-29 15:09:12,363::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf69f07a8cd2dd01dbf3e7bb46d1789c13fd32f2'] >Thread-440::DEBUG::2012-11-29 15:09:12,364::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-440::WARNING::2012-11-29 15:09:12,364::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-440::WARNING::2012-11-29 15:09:12,364::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-440::DEBUG::2012-11-29 15:09:12,365::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-440::DEBUG::2012-11-29 15:09:12,365::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-440::DEBUG::2012-11-29 15:09:12,365::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-440::DEBUG::2012-11-29 15:09:12,368::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf69f07a8cd2dd01dbf3e7bb46d1789c13fd32f2'] >Thread-440::DEBUG::2012-11-29 15:09:12,368::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` started monitoring domain `646a3b8e-d5dd-4bf7-be3d-384526eabdd1` >Thread-440::DEBUG::2012-11-29 15:09:12,369::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-444::DEBUG::2012-11-29 15:09:12,369::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-440::WARNING::2012-11-29 15:09:12,370::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-440::DEBUG::2012-11-29 15:09:12,372::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-440::DEBUG::2012-11-29 15:09:12,377::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-444::INFO::2012-11-29 15:09:12,388::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 1) >Thread-444::DEBUG::2012-11-29 15:09:12,389::safelease::178::SANLock::(acquireHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully acquired (id: 1) >Thread-440::DEBUG::2012-11-29 15:09:12,521::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-440::DEBUG::2012-11-29 15:09:12,521::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-440::INFO::2012-11-29 15:09:12,523::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-440::INFO::2012-11-29 15:09:12,524::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-440::DEBUG::2012-11-29 15:09:12,524::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-440::DEBUG::2012-11-29 15:09:12,524::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-440::DEBUG::2012-11-29 15:09:12,525::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-440::DEBUG::2012-11-29 15:09:12,525::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-440::INFO::2012-11-29 15:09:12,525::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-440::DEBUG::2012-11-29 15:09:12,525::task::1151::TaskManager.Task::(prepare) Task=`e2038e4d-e8b2-4609-b4ae-1d6a7c9076ee`::finished: True >Thread-440::DEBUG::2012-11-29 15:09:12,525::task::568::TaskManager.Task::(_updateState) Task=`e2038e4d-e8b2-4609-b4ae-1d6a7c9076ee`::moving from state preparing -> state finished >Thread-440::DEBUG::2012-11-29 15:09:12,526::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-440::DEBUG::2012-11-29 15:09:12,526::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-440::DEBUG::2012-11-29 15:09:12,526::task::957::TaskManager.Task::(_decref) Task=`e2038e4d-e8b2-4609-b4ae-1d6a7c9076ee`::ref 0 aborting False >Thread-446::DEBUG::2012-11-29 15:09:12,553::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-446::DEBUG::2012-11-29 15:09:12,553::task::568::TaskManager.Task::(_updateState) Task=`a466eb3b-9af2-4f85-a752-5318ddeaa291`::moving from state init -> state preparing >Thread-446::INFO::2012-11-29 15:09:12,553::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-446::INFO::2012-11-29 15:09:12,554::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-446::DEBUG::2012-11-29 15:09:12,554::task::1151::TaskManager.Task::(prepare) Task=`a466eb3b-9af2-4f85-a752-5318ddeaa291`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-446::DEBUG::2012-11-29 15:09:12,554::task::568::TaskManager.Task::(_updateState) Task=`a466eb3b-9af2-4f85-a752-5318ddeaa291`::moving from state preparing -> state finished >Thread-446::DEBUG::2012-11-29 15:09:12,554::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-446::DEBUG::2012-11-29 15:09:12,555::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-446::DEBUG::2012-11-29 15:09:12,555::task::957::TaskManager.Task::(_decref) Task=`a466eb3b-9af2-4f85-a752-5318ddeaa291`::ref 0 aborting False >Thread-447::DEBUG::2012-11-29 15:09:12,590::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-447::DEBUG::2012-11-29 15:09:12,590::task::568::TaskManager.Task::(_updateState) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::moving from state init -> state preparing >Thread-447::INFO::2012-11-29 15:09:12,590::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-447::DEBUG::2012-11-29 15:09:12,591::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`fb40f7c7-6a5c-4f55-95de-09fbb70cb9a2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-447::DEBUG::2012-11-29 15:09:12,591::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-447::DEBUG::2012-11-29 15:09:12,591::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-447::DEBUG::2012-11-29 15:09:12,592::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`fb40f7c7-6a5c-4f55-95de-09fbb70cb9a2`::Granted request >Thread-447::DEBUG::2012-11-29 15:09:12,592::task::794::TaskManager.Task::(resourceAcquired) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-447::DEBUG::2012-11-29 15:09:12,592::task::957::TaskManager.Task::(_decref) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::ref 1 aborting False >Thread-447::INFO::2012-11-29 15:09:12,592::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-447::DEBUG::2012-11-29 15:09:12,593::task::1146::TaskManager.Task::(prepare) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::Prepare: 1 jobs exist, move to acquiring >Thread-447::DEBUG::2012-11-29 15:09:12,593::task::568::TaskManager.Task::(_updateState) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::moving from state preparing -> state acquiring >Thread-447::DEBUG::2012-11-29 15:09:12,593::task::568::TaskManager.Task::(_updateState) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::moving from state acquiring -> state queued >Thread-447::DEBUG::2012-11-29 15:09:12,593::taskManager::50::TaskManager::(_queueTask) queuing task: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-447::DEBUG::2012-11-29 15:09:12,593::taskManager::56::TaskManager::(_queueTask) task queued: c6e85019-8176-4c95-89fc-34ca1d277c2b >f4f8833f-96c5-41b1-85ad-5c8806d9cc7e::DEBUG::2012-11-29 15:09:12,594::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,595::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: c6e85019-8176-4c95-89fc-34ca1d277c2b running: <bound method Task.commit of <storage.task.Task instance at 0x274f518>> with: None >Thread-447::DEBUG::2012-11-29 15:09:12,595::task::1148::TaskManager.Task::(prepare) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::returning >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,596::task::1159::TaskManager.Task::(commit) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::committing task: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-447::DEBUG::2012-11-29 15:09:12,597::task::957::TaskManager.Task::(_decref) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::ref 0 aborting False >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,597::task::568::TaskManager.Task::(_updateState) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::moving from state queued -> state running >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,599::task::872::TaskManager.Task::(_runJobs) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x2743c90>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,600::task::304::TaskManager.Task::(run) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x2743c90>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,602::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,602::misc::1027::SamplingMethod::(__call__) Got in to sampling method >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,605::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf69f07a8cd2dd01dbf3e7bb46d1789c13fd32f2'] >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,605::misc::1035::SamplingMethod::(__call__) Returning last result >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:12,608::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf69f07a8cd2dd01dbf3e7bb46d1789c13fd32f2'] >c6e85019-8176-4c95-89fc-34ca1d277c2b::INFO::2012-11-29 15:09:12,608::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 1) >Thread-448::DEBUG::2012-11-29 15:09:13,629::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-448::DEBUG::2012-11-29 15:09:13,629::task::568::TaskManager.Task::(_updateState) Task=`28380765-170c-4dd2-8888-e480c0ad8316`::moving from state init -> state preparing >Thread-448::INFO::2012-11-29 15:09:13,630::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-448::DEBUG::2012-11-29 15:09:13,630::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-448::DEBUG::2012-11-29 15:09:13,630::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-448::INFO::2012-11-29 15:09:13,630::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-448::DEBUG::2012-11-29 15:09:13,630::task::1151::TaskManager.Task::(prepare) Task=`28380765-170c-4dd2-8888-e480c0ad8316`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-448::DEBUG::2012-11-29 15:09:13,630::task::568::TaskManager.Task::(_updateState) Task=`28380765-170c-4dd2-8888-e480c0ad8316`::moving from state preparing -> state finished >Thread-448::DEBUG::2012-11-29 15:09:13,631::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-448::DEBUG::2012-11-29 15:09:13,631::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-448::DEBUG::2012-11-29 15:09:13,631::task::957::TaskManager.Task::(_decref) Task=`28380765-170c-4dd2-8888-e480c0ad8316`::ref 0 aborting False >Thread-449::DEBUG::2012-11-29 15:09:14,182::task::568::TaskManager.Task::(_updateState) Task=`c74d9c68-5681-4acd-b909-42ec51770bfa`::moving from state init -> state preparing >Thread-449::INFO::2012-11-29 15:09:14,182::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-449::INFO::2012-11-29 15:09:14,182::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00196194648743', 'lastCheck': '1.8', 'code': 0, 'valid': True}} >Thread-449::DEBUG::2012-11-29 15:09:14,183::task::1151::TaskManager.Task::(prepare) Task=`c74d9c68-5681-4acd-b909-42ec51770bfa`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00196194648743', 'lastCheck': '1.8', 'code': 0, 'valid': True}} >Thread-449::DEBUG::2012-11-29 15:09:14,183::task::568::TaskManager.Task::(_updateState) Task=`c74d9c68-5681-4acd-b909-42ec51770bfa`::moving from state preparing -> state finished >Thread-449::DEBUG::2012-11-29 15:09:14,183::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-449::DEBUG::2012-11-29 15:09:14,183::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-449::DEBUG::2012-11-29 15:09:14,183::task::957::TaskManager.Task::(_decref) Task=`c74d9c68-5681-4acd-b909-42ec51770bfa`::ref 0 aborting False >Thread-451::DEBUG::2012-11-29 15:09:14,658::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-451::DEBUG::2012-11-29 15:09:14,658::task::568::TaskManager.Task::(_updateState) Task=`58c69673-1fe6-4434-85a2-70c9c08d216a`::moving from state init -> state preparing >Thread-451::INFO::2012-11-29 15:09:14,659::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-451::DEBUG::2012-11-29 15:09:14,659::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-451::DEBUG::2012-11-29 15:09:14,659::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-451::INFO::2012-11-29 15:09:14,659::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-451::DEBUG::2012-11-29 15:09:14,659::task::1151::TaskManager.Task::(prepare) Task=`58c69673-1fe6-4434-85a2-70c9c08d216a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-451::DEBUG::2012-11-29 15:09:14,660::task::568::TaskManager.Task::(_updateState) Task=`58c69673-1fe6-4434-85a2-70c9c08d216a`::moving from state preparing -> state finished >Thread-451::DEBUG::2012-11-29 15:09:14,660::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-451::DEBUG::2012-11-29 15:09:14,660::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-451::DEBUG::2012-11-29 15:09:14,660::task::957::TaskManager.Task::(_decref) Task=`58c69673-1fe6-4434-85a2-70c9c08d216a`::ref 0 aborting False >Thread-452::DEBUG::2012-11-29 15:09:15,690::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-452::DEBUG::2012-11-29 15:09:15,690::task::568::TaskManager.Task::(_updateState) Task=`35856480-1f1e-41ff-b0f6-7342d8ad8eeb`::moving from state init -> state preparing >Thread-452::INFO::2012-11-29 15:09:15,690::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-452::DEBUG::2012-11-29 15:09:15,691::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-452::DEBUG::2012-11-29 15:09:15,691::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-452::INFO::2012-11-29 15:09:15,691::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-452::DEBUG::2012-11-29 15:09:15,691::task::1151::TaskManager.Task::(prepare) Task=`35856480-1f1e-41ff-b0f6-7342d8ad8eeb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-452::DEBUG::2012-11-29 15:09:15,691::task::568::TaskManager.Task::(_updateState) Task=`35856480-1f1e-41ff-b0f6-7342d8ad8eeb`::moving from state preparing -> state finished >Thread-452::DEBUG::2012-11-29 15:09:15,691::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-452::DEBUG::2012-11-29 15:09:15,691::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-452::DEBUG::2012-11-29 15:09:15,692::task::957::TaskManager.Task::(_decref) Task=`35856480-1f1e-41ff-b0f6-7342d8ad8eeb`::ref 0 aborting False >Thread-454::DEBUG::2012-11-29 15:09:16,719::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-454::DEBUG::2012-11-29 15:09:16,719::task::568::TaskManager.Task::(_updateState) Task=`a0e5513e-8cab-42da-ab71-c6dae0986b06`::moving from state init -> state preparing >Thread-454::INFO::2012-11-29 15:09:16,719::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-454::DEBUG::2012-11-29 15:09:16,719::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-454::DEBUG::2012-11-29 15:09:16,720::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-454::INFO::2012-11-29 15:09:16,720::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-454::DEBUG::2012-11-29 15:09:16,720::task::1151::TaskManager.Task::(prepare) Task=`a0e5513e-8cab-42da-ab71-c6dae0986b06`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-454::DEBUG::2012-11-29 15:09:16,720::task::568::TaskManager.Task::(_updateState) Task=`a0e5513e-8cab-42da-ab71-c6dae0986b06`::moving from state preparing -> state finished >Thread-454::DEBUG::2012-11-29 15:09:16,720::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-454::DEBUG::2012-11-29 15:09:16,720::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-454::DEBUG::2012-11-29 15:09:16,721::task::957::TaskManager.Task::(_decref) Task=`a0e5513e-8cab-42da-ab71-c6dae0986b06`::ref 0 aborting False >Thread-455::DEBUG::2012-11-29 15:09:17,750::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-455::DEBUG::2012-11-29 15:09:17,751::task::568::TaskManager.Task::(_updateState) Task=`3ed44066-a4f2-4379-8a0e-30673b9d92f8`::moving from state init -> state preparing >Thread-455::INFO::2012-11-29 15:09:17,751::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-455::DEBUG::2012-11-29 15:09:17,751::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-455::DEBUG::2012-11-29 15:09:17,751::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-455::INFO::2012-11-29 15:09:17,751::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-455::DEBUG::2012-11-29 15:09:17,751::task::1151::TaskManager.Task::(prepare) Task=`3ed44066-a4f2-4379-8a0e-30673b9d92f8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-455::DEBUG::2012-11-29 15:09:17,752::task::568::TaskManager.Task::(_updateState) Task=`3ed44066-a4f2-4379-8a0e-30673b9d92f8`::moving from state preparing -> state finished >Thread-455::DEBUG::2012-11-29 15:09:17,752::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-455::DEBUG::2012-11-29 15:09:17,752::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-455::DEBUG::2012-11-29 15:09:17,752::task::957::TaskManager.Task::(_decref) Task=`3ed44066-a4f2-4379-8a0e-30673b9d92f8`::ref 0 aborting False >Thread-457::DEBUG::2012-11-29 15:09:18,783::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-457::DEBUG::2012-11-29 15:09:18,784::task::568::TaskManager.Task::(_updateState) Task=`1466056f-44e3-4214-b1a0-88d902584397`::moving from state init -> state preparing >Thread-457::INFO::2012-11-29 15:09:18,784::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-457::DEBUG::2012-11-29 15:09:18,784::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-457::DEBUG::2012-11-29 15:09:18,784::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-457::INFO::2012-11-29 15:09:18,784::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-457::DEBUG::2012-11-29 15:09:18,784::task::1151::TaskManager.Task::(prepare) Task=`1466056f-44e3-4214-b1a0-88d902584397`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-457::DEBUG::2012-11-29 15:09:18,785::task::568::TaskManager.Task::(_updateState) Task=`1466056f-44e3-4214-b1a0-88d902584397`::moving from state preparing -> state finished >Thread-457::DEBUG::2012-11-29 15:09:18,785::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-457::DEBUG::2012-11-29 15:09:18,785::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-457::DEBUG::2012-11-29 15:09:18,785::task::957::TaskManager.Task::(_decref) Task=`1466056f-44e3-4214-b1a0-88d902584397`::ref 0 aborting False >Thread-458::DEBUG::2012-11-29 15:09:19,813::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-458::DEBUG::2012-11-29 15:09:19,813::task::568::TaskManager.Task::(_updateState) Task=`d9fa977f-042a-42c8-9fcf-d9ed185addf3`::moving from state init -> state preparing >Thread-458::INFO::2012-11-29 15:09:19,813::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-458::DEBUG::2012-11-29 15:09:19,814::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-458::DEBUG::2012-11-29 15:09:19,814::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-458::INFO::2012-11-29 15:09:19,814::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-458::DEBUG::2012-11-29 15:09:19,814::task::1151::TaskManager.Task::(prepare) Task=`d9fa977f-042a-42c8-9fcf-d9ed185addf3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-458::DEBUG::2012-11-29 15:09:19,814::task::568::TaskManager.Task::(_updateState) Task=`d9fa977f-042a-42c8-9fcf-d9ed185addf3`::moving from state preparing -> state finished >Thread-458::DEBUG::2012-11-29 15:09:19,814::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-458::DEBUG::2012-11-29 15:09:19,814::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-458::DEBUG::2012-11-29 15:09:19,815::task::957::TaskManager.Task::(_decref) Task=`d9fa977f-042a-42c8-9fcf-d9ed185addf3`::ref 0 aborting False >Thread-460::DEBUG::2012-11-29 15:09:20,842::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-460::DEBUG::2012-11-29 15:09:20,842::task::568::TaskManager.Task::(_updateState) Task=`b43f0de6-e02b-4268-a4fe-44766647e012`::moving from state init -> state preparing >Thread-460::INFO::2012-11-29 15:09:20,842::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-460::DEBUG::2012-11-29 15:09:20,843::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-460::DEBUG::2012-11-29 15:09:20,843::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-460::INFO::2012-11-29 15:09:20,843::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-460::DEBUG::2012-11-29 15:09:20,843::task::1151::TaskManager.Task::(prepare) Task=`b43f0de6-e02b-4268-a4fe-44766647e012`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-460::DEBUG::2012-11-29 15:09:20,843::task::568::TaskManager.Task::(_updateState) Task=`b43f0de6-e02b-4268-a4fe-44766647e012`::moving from state preparing -> state finished >Thread-460::DEBUG::2012-11-29 15:09:20,843::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-460::DEBUG::2012-11-29 15:09:20,844::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-460::DEBUG::2012-11-29 15:09:20,844::task::957::TaskManager.Task::(_decref) Task=`b43f0de6-e02b-4268-a4fe-44766647e012`::ref 0 aborting False >Thread-461::DEBUG::2012-11-29 15:09:21,871::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-461::DEBUG::2012-11-29 15:09:21,872::task::568::TaskManager.Task::(_updateState) Task=`8ec3027c-cd81-4143-b54f-d7a04cfd58ef`::moving from state init -> state preparing >Thread-461::INFO::2012-11-29 15:09:21,872::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-461::DEBUG::2012-11-29 15:09:21,872::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-461::DEBUG::2012-11-29 15:09:21,872::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-461::INFO::2012-11-29 15:09:21,872::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-461::DEBUG::2012-11-29 15:09:21,872::task::1151::TaskManager.Task::(prepare) Task=`8ec3027c-cd81-4143-b54f-d7a04cfd58ef`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-461::DEBUG::2012-11-29 15:09:21,873::task::568::TaskManager.Task::(_updateState) Task=`8ec3027c-cd81-4143-b54f-d7a04cfd58ef`::moving from state preparing -> state finished >Thread-461::DEBUG::2012-11-29 15:09:21,873::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-461::DEBUG::2012-11-29 15:09:21,873::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-461::DEBUG::2012-11-29 15:09:21,873::task::957::TaskManager.Task::(_decref) Task=`8ec3027c-cd81-4143-b54f-d7a04cfd58ef`::ref 0 aborting False >Thread-463::DEBUG::2012-11-29 15:09:22,900::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-463::DEBUG::2012-11-29 15:09:22,901::task::568::TaskManager.Task::(_updateState) Task=`2e86b2e7-87bb-4618-84d0-19507fb3b784`::moving from state init -> state preparing >Thread-463::INFO::2012-11-29 15:09:22,901::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-463::DEBUG::2012-11-29 15:09:22,901::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-463::DEBUG::2012-11-29 15:09:22,901::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-463::INFO::2012-11-29 15:09:22,901::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-463::DEBUG::2012-11-29 15:09:22,901::task::1151::TaskManager.Task::(prepare) Task=`2e86b2e7-87bb-4618-84d0-19507fb3b784`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-463::DEBUG::2012-11-29 15:09:22,902::task::568::TaskManager.Task::(_updateState) Task=`2e86b2e7-87bb-4618-84d0-19507fb3b784`::moving from state preparing -> state finished >Thread-463::DEBUG::2012-11-29 15:09:22,902::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-463::DEBUG::2012-11-29 15:09:22,902::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-463::DEBUG::2012-11-29 15:09:22,902::task::957::TaskManager.Task::(_decref) Task=`2e86b2e7-87bb-4618-84d0-19507fb3b784`::ref 0 aborting False >Thread-464::DEBUG::2012-11-29 15:09:23,930::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-464::DEBUG::2012-11-29 15:09:23,930::task::568::TaskManager.Task::(_updateState) Task=`18a11f6d-b4ba-40a2-bf79-c1abd28d8c0f`::moving from state init -> state preparing >Thread-464::INFO::2012-11-29 15:09:23,930::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-464::DEBUG::2012-11-29 15:09:23,931::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-464::DEBUG::2012-11-29 15:09:23,931::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-464::INFO::2012-11-29 15:09:23,931::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-464::DEBUG::2012-11-29 15:09:23,931::task::1151::TaskManager.Task::(prepare) Task=`18a11f6d-b4ba-40a2-bf79-c1abd28d8c0f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-464::DEBUG::2012-11-29 15:09:23,931::task::568::TaskManager.Task::(_updateState) Task=`18a11f6d-b4ba-40a2-bf79-c1abd28d8c0f`::moving from state preparing -> state finished >Thread-464::DEBUG::2012-11-29 15:09:23,931::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-464::DEBUG::2012-11-29 15:09:23,932::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-464::DEBUG::2012-11-29 15:09:23,932::task::957::TaskManager.Task::(_decref) Task=`18a11f6d-b4ba-40a2-bf79-c1abd28d8c0f`::ref 0 aborting False >Thread-465::DEBUG::2012-11-29 15:09:24,377::task::568::TaskManager.Task::(_updateState) Task=`5987d978-a0bc-4def-9af6-3e184464e6d5`::moving from state init -> state preparing >Thread-465::INFO::2012-11-29 15:09:24,378::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-465::INFO::2012-11-29 15:09:24,378::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00196194648743', 'lastCheck': '12.0', 'code': 0, 'valid': True}} >Thread-465::DEBUG::2012-11-29 15:09:24,378::task::1151::TaskManager.Task::(prepare) Task=`5987d978-a0bc-4def-9af6-3e184464e6d5`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00196194648743', 'lastCheck': '12.0', 'code': 0, 'valid': True}} >Thread-465::DEBUG::2012-11-29 15:09:24,378::task::568::TaskManager.Task::(_updateState) Task=`5987d978-a0bc-4def-9af6-3e184464e6d5`::moving from state preparing -> state finished >Thread-465::DEBUG::2012-11-29 15:09:24,378::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-465::DEBUG::2012-11-29 15:09:24,378::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-465::DEBUG::2012-11-29 15:09:24,379::task::957::TaskManager.Task::(_decref) Task=`5987d978-a0bc-4def-9af6-3e184464e6d5`::ref 0 aborting False >Thread-467::DEBUG::2012-11-29 15:09:24,960::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-467::DEBUG::2012-11-29 15:09:24,960::task::568::TaskManager.Task::(_updateState) Task=`3cb3364c-b002-4070-92a0-e5dcfd97d855`::moving from state init -> state preparing >Thread-467::INFO::2012-11-29 15:09:24,961::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-467::DEBUG::2012-11-29 15:09:24,961::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-467::DEBUG::2012-11-29 15:09:24,961::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-467::INFO::2012-11-29 15:09:24,961::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-467::DEBUG::2012-11-29 15:09:24,961::task::1151::TaskManager.Task::(prepare) Task=`3cb3364c-b002-4070-92a0-e5dcfd97d855`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-467::DEBUG::2012-11-29 15:09:24,961::task::568::TaskManager.Task::(_updateState) Task=`3cb3364c-b002-4070-92a0-e5dcfd97d855`::moving from state preparing -> state finished >Thread-467::DEBUG::2012-11-29 15:09:24,961::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-467::DEBUG::2012-11-29 15:09:24,962::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-467::DEBUG::2012-11-29 15:09:24,962::task::957::TaskManager.Task::(_decref) Task=`3cb3364c-b002-4070-92a0-e5dcfd97d855`::ref 0 aborting False >Thread-468::DEBUG::2012-11-29 15:09:25,989::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-468::DEBUG::2012-11-29 15:09:25,989::task::568::TaskManager.Task::(_updateState) Task=`00f6f6b0-6a09-4bbc-9dc8-d3f7947f57a9`::moving from state init -> state preparing >Thread-468::INFO::2012-11-29 15:09:25,989::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-468::DEBUG::2012-11-29 15:09:25,990::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-468::DEBUG::2012-11-29 15:09:25,990::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-468::INFO::2012-11-29 15:09:25,990::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-468::DEBUG::2012-11-29 15:09:25,990::task::1151::TaskManager.Task::(prepare) Task=`00f6f6b0-6a09-4bbc-9dc8-d3f7947f57a9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-468::DEBUG::2012-11-29 15:09:25,990::task::568::TaskManager.Task::(_updateState) Task=`00f6f6b0-6a09-4bbc-9dc8-d3f7947f57a9`::moving from state preparing -> state finished >Thread-468::DEBUG::2012-11-29 15:09:25,990::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-468::DEBUG::2012-11-29 15:09:25,990::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-468::DEBUG::2012-11-29 15:09:25,991::task::957::TaskManager.Task::(_decref) Task=`00f6f6b0-6a09-4bbc-9dc8-d3f7947f57a9`::ref 0 aborting False >Thread-470::DEBUG::2012-11-29 15:09:27,018::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-470::DEBUG::2012-11-29 15:09:27,018::task::568::TaskManager.Task::(_updateState) Task=`a9451a42-04e4-487b-b2d4-406ce4373c4b`::moving from state init -> state preparing >Thread-470::INFO::2012-11-29 15:09:27,018::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-470::DEBUG::2012-11-29 15:09:27,018::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-470::DEBUG::2012-11-29 15:09:27,018::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-470::INFO::2012-11-29 15:09:27,019::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-470::DEBUG::2012-11-29 15:09:27,019::task::1151::TaskManager.Task::(prepare) Task=`a9451a42-04e4-487b-b2d4-406ce4373c4b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-470::DEBUG::2012-11-29 15:09:27,019::task::568::TaskManager.Task::(_updateState) Task=`a9451a42-04e4-487b-b2d4-406ce4373c4b`::moving from state preparing -> state finished >Thread-470::DEBUG::2012-11-29 15:09:27,019::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-470::DEBUG::2012-11-29 15:09:27,019::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-470::DEBUG::2012-11-29 15:09:27,019::task::957::TaskManager.Task::(_decref) Task=`a9451a42-04e4-487b-b2d4-406ce4373c4b`::ref 0 aborting False >Thread-471::DEBUG::2012-11-29 15:09:28,047::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-471::DEBUG::2012-11-29 15:09:28,047::task::568::TaskManager.Task::(_updateState) Task=`fdc25424-f396-4dbd-8b1b-6d9eb559b5c8`::moving from state init -> state preparing >Thread-471::INFO::2012-11-29 15:09:28,047::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-471::DEBUG::2012-11-29 15:09:28,048::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-471::DEBUG::2012-11-29 15:09:28,048::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-471::INFO::2012-11-29 15:09:28,048::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-471::DEBUG::2012-11-29 15:09:28,048::task::1151::TaskManager.Task::(prepare) Task=`fdc25424-f396-4dbd-8b1b-6d9eb559b5c8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-471::DEBUG::2012-11-29 15:09:28,048::task::568::TaskManager.Task::(_updateState) Task=`fdc25424-f396-4dbd-8b1b-6d9eb559b5c8`::moving from state preparing -> state finished >Thread-471::DEBUG::2012-11-29 15:09:28,048::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-471::DEBUG::2012-11-29 15:09:28,049::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-471::DEBUG::2012-11-29 15:09:28,049::task::957::TaskManager.Task::(_decref) Task=`fdc25424-f396-4dbd-8b1b-6d9eb559b5c8`::ref 0 aborting False >Thread-473::DEBUG::2012-11-29 15:09:29,076::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-473::DEBUG::2012-11-29 15:09:29,076::task::568::TaskManager.Task::(_updateState) Task=`4db3aa6c-cc12-45cf-9f3d-e1b15f2143e0`::moving from state init -> state preparing >Thread-473::INFO::2012-11-29 15:09:29,076::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-473::DEBUG::2012-11-29 15:09:29,077::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-473::DEBUG::2012-11-29 15:09:29,077::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-473::INFO::2012-11-29 15:09:29,077::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-473::DEBUG::2012-11-29 15:09:29,077::task::1151::TaskManager.Task::(prepare) Task=`4db3aa6c-cc12-45cf-9f3d-e1b15f2143e0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-473::DEBUG::2012-11-29 15:09:29,077::task::568::TaskManager.Task::(_updateState) Task=`4db3aa6c-cc12-45cf-9f3d-e1b15f2143e0`::moving from state preparing -> state finished >Thread-473::DEBUG::2012-11-29 15:09:29,077::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-473::DEBUG::2012-11-29 15:09:29,077::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-473::DEBUG::2012-11-29 15:09:29,078::task::957::TaskManager.Task::(_decref) Task=`4db3aa6c-cc12-45cf-9f3d-e1b15f2143e0`::ref 0 aborting False >Thread-474::DEBUG::2012-11-29 15:09:30,104::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-474::DEBUG::2012-11-29 15:09:30,105::task::568::TaskManager.Task::(_updateState) Task=`2afe8be8-5aa0-44a2-81d6-44344fd4bf8a`::moving from state init -> state preparing >Thread-474::INFO::2012-11-29 15:09:30,105::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-474::DEBUG::2012-11-29 15:09:30,105::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-474::DEBUG::2012-11-29 15:09:30,105::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-474::INFO::2012-11-29 15:09:30,105::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-474::DEBUG::2012-11-29 15:09:30,106::task::1151::TaskManager.Task::(prepare) Task=`2afe8be8-5aa0-44a2-81d6-44344fd4bf8a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-474::DEBUG::2012-11-29 15:09:30,106::task::568::TaskManager.Task::(_updateState) Task=`2afe8be8-5aa0-44a2-81d6-44344fd4bf8a`::moving from state preparing -> state finished >Thread-474::DEBUG::2012-11-29 15:09:30,106::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-474::DEBUG::2012-11-29 15:09:30,106::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-474::DEBUG::2012-11-29 15:09:30,106::task::957::TaskManager.Task::(_decref) Task=`2afe8be8-5aa0-44a2-81d6-44344fd4bf8a`::ref 0 aborting False >Thread-476::DEBUG::2012-11-29 15:09:31,134::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-476::DEBUG::2012-11-29 15:09:31,134::task::568::TaskManager.Task::(_updateState) Task=`fde82dec-ede9-4e27-b301-ce5b8eb99c87`::moving from state init -> state preparing >Thread-476::INFO::2012-11-29 15:09:31,134::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-476::DEBUG::2012-11-29 15:09:31,135::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-476::DEBUG::2012-11-29 15:09:31,135::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-476::INFO::2012-11-29 15:09:31,135::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-476::DEBUG::2012-11-29 15:09:31,135::task::1151::TaskManager.Task::(prepare) Task=`fde82dec-ede9-4e27-b301-ce5b8eb99c87`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-476::DEBUG::2012-11-29 15:09:31,135::task::568::TaskManager.Task::(_updateState) Task=`fde82dec-ede9-4e27-b301-ce5b8eb99c87`::moving from state preparing -> state finished >Thread-476::DEBUG::2012-11-29 15:09:31,135::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-476::DEBUG::2012-11-29 15:09:31,136::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-476::DEBUG::2012-11-29 15:09:31,136::task::957::TaskManager.Task::(_decref) Task=`fde82dec-ede9-4e27-b301-ce5b8eb99c87`::ref 0 aborting False >Thread-477::DEBUG::2012-11-29 15:09:32,164::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-477::DEBUG::2012-11-29 15:09:32,165::task::568::TaskManager.Task::(_updateState) Task=`c015b7dc-0ff1-4fd1-86f8-30c6da2f86e0`::moving from state init -> state preparing >Thread-477::INFO::2012-11-29 15:09:32,165::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-477::DEBUG::2012-11-29 15:09:32,165::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-477::DEBUG::2012-11-29 15:09:32,165::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-477::INFO::2012-11-29 15:09:32,165::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-477::DEBUG::2012-11-29 15:09:32,166::task::1151::TaskManager.Task::(prepare) Task=`c015b7dc-0ff1-4fd1-86f8-30c6da2f86e0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-477::DEBUG::2012-11-29 15:09:32,166::task::568::TaskManager.Task::(_updateState) Task=`c015b7dc-0ff1-4fd1-86f8-30c6da2f86e0`::moving from state preparing -> state finished >Thread-477::DEBUG::2012-11-29 15:09:32,166::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-477::DEBUG::2012-11-29 15:09:32,166::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-477::DEBUG::2012-11-29 15:09:32,166::task::957::TaskManager.Task::(_decref) Task=`c015b7dc-0ff1-4fd1-86f8-30c6da2f86e0`::ref 0 aborting False >Thread-479::DEBUG::2012-11-29 15:09:33,194::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-479::DEBUG::2012-11-29 15:09:33,194::task::568::TaskManager.Task::(_updateState) Task=`f51c6193-cb87-4034-8c20-1daeb07823e4`::moving from state init -> state preparing >Thread-479::INFO::2012-11-29 15:09:33,195::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-479::DEBUG::2012-11-29 15:09:33,195::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-479::DEBUG::2012-11-29 15:09:33,195::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-479::INFO::2012-11-29 15:09:33,195::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-479::DEBUG::2012-11-29 15:09:33,195::task::1151::TaskManager.Task::(prepare) Task=`f51c6193-cb87-4034-8c20-1daeb07823e4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-479::DEBUG::2012-11-29 15:09:33,195::task::568::TaskManager.Task::(_updateState) Task=`f51c6193-cb87-4034-8c20-1daeb07823e4`::moving from state preparing -> state finished >Thread-479::DEBUG::2012-11-29 15:09:33,196::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-479::DEBUG::2012-11-29 15:09:33,196::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-479::DEBUG::2012-11-29 15:09:33,196::task::957::TaskManager.Task::(_decref) Task=`f51c6193-cb87-4034-8c20-1daeb07823e4`::ref 0 aborting False >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,611::safelease::178::SANLock::(acquireHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully acquired (id: 1) >c6e85019-8176-4c95-89fc-34ca1d277c2b::INFO::2012-11-29 15:09:33,612::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 1) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,648::safelease::235::SANLock::(acquire) Cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully acquired (id: 1) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,648::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,651::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf69f07a8cd2dd01dbf3e7bb46d1789c13fd32f2'] >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,651::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,651::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,651::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=23685913df2061b4003661be04b2e3360a6a2189'] >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,654::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,655::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`bd749094-f089-4c0b-a039-bb615e5916a4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,655::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,655::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,655::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`bd749094-f089-4c0b-a039-bb615e5916a4`::Granted request >c6e85019-8176-4c95-89fc-34ca1d277c2b::INFO::2012-11-29 15:09:33,656::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `646a3b8e-d5dd-4bf7-be3d-384526eabdd1` >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,656::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`5b966153-cdf0-430a-90d8-b112cd6ade11`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,656::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'exclusive' >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,656::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'exclusive' (1 active user) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,657::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`5b966153-cdf0-430a-90d8-b112cd6ade11`::Granted request >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,657::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,658::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,808::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >c6e85019-8176-4c95-89fc-34ca1d277c2b::WARNING::2012-11-29 15:09:33,809::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,809::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,813::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,814::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,817::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=23685913df2061b4003661be04b2e3360a6a2189'] >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,818::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >c6e85019-8176-4c95-89fc-34ca1d277c2b::WARNING::2012-11-29 15:09:33,818::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >c6e85019-8176-4c95-89fc-34ca1d277c2b::WARNING::2012-11-29 15:09:33,818::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,819::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,819::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,819::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,819::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,820::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,820::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,820::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,820::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,820::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,821::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,821::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >c6e85019-8176-4c95-89fc-34ca1d277c2b::WARNING::2012-11-29 15:09:33,823::sd::590::Storage.StorageDomain::(createMasterTree) vms dir not found, creating (/rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1/master/vms) >c6e85019-8176-4c95-89fc-34ca1d277c2b::WARNING::2012-11-29 15:09:33,824::sd::595::Storage.StorageDomain::(createMasterTree) tasks dir not found, creating (/rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1/master/tasks) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,825::sp::309::Storage.StoragePool::(startSpm) ended. >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,825::task::568::TaskManager.Task::(_updateState) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::moving from state running -> state finished >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,826::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,826::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,826::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,826::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,826::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,827::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,827::task::880::TaskManager.Task::(_runJobs) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::Task.run: exit - success: result >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,827::task::957::TaskManager.Task::(_decref) Task=`c6e85019-8176-4c95-89fc-34ca1d277c2b`::ref 0 aborting False >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:09:33,827::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-481::DEBUG::2012-11-29 15:09:34,223::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-481::DEBUG::2012-11-29 15:09:34,224::task::568::TaskManager.Task::(_updateState) Task=`e0c4e034-e26e-46f9-9db0-ede968c05e67`::moving from state init -> state preparing >Thread-481::INFO::2012-11-29 15:09:34,224::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-481::DEBUG::2012-11-29 15:09:34,224::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-481::DEBUG::2012-11-29 15:09:34,225::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'} >Thread-481::INFO::2012-11-29 15:09:34,225::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-481::DEBUG::2012-11-29 15:09:34,225::task::1151::TaskManager.Task::(prepare) Task=`e0c4e034-e26e-46f9-9db0-ede968c05e67`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c6e85019-8176-4c95-89fc-34ca1d277c2b'}} >Thread-481::DEBUG::2012-11-29 15:09:34,225::task::568::TaskManager.Task::(_updateState) Task=`e0c4e034-e26e-46f9-9db0-ede968c05e67`::moving from state preparing -> state finished >Thread-481::DEBUG::2012-11-29 15:09:34,225::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-481::DEBUG::2012-11-29 15:09:34,225::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-481::DEBUG::2012-11-29 15:09:34,226::task::957::TaskManager.Task::(_decref) Task=`e0c4e034-e26e-46f9-9db0-ede968c05e67`::ref 0 aborting False >Thread-482::DEBUG::2012-11-29 15:09:34,250::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-482::DEBUG::2012-11-29 15:09:34,251::task::568::TaskManager.Task::(_updateState) Task=`75b5aa9a-d4b1-42d1-87c5-9498c35b5790`::moving from state init -> state preparing >Thread-482::INFO::2012-11-29 15:09:34,251::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-482::INFO::2012-11-29 15:09:34,251::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-482::DEBUG::2012-11-29 15:09:34,251::task::1151::TaskManager.Task::(prepare) Task=`75b5aa9a-d4b1-42d1-87c5-9498c35b5790`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-482::DEBUG::2012-11-29 15:09:34,252::task::568::TaskManager.Task::(_updateState) Task=`75b5aa9a-d4b1-42d1-87c5-9498c35b5790`::moving from state preparing -> state finished >Thread-482::DEBUG::2012-11-29 15:09:34,252::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-482::DEBUG::2012-11-29 15:09:34,252::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-482::DEBUG::2012-11-29 15:09:34,252::task::957::TaskManager.Task::(_decref) Task=`75b5aa9a-d4b1-42d1-87c5-9498c35b5790`::ref 0 aborting False >Thread-483::DEBUG::2012-11-29 15:09:34,280::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-483::DEBUG::2012-11-29 15:09:34,281::task::568::TaskManager.Task::(_updateState) Task=`81fd575d-a8ce-46db-9fe6-1c2fd081f436`::moving from state init -> state preparing >Thread-483::INFO::2012-11-29 15:09:34,281::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='c6e85019-8176-4c95-89fc-34ca1d277c2b', spUUID=None, options=None) >Thread-483::DEBUG::2012-11-29 15:09:34,281::taskManager::161::TaskManager::(clearTask) Entry. taskID: c6e85019-8176-4c95-89fc-34ca1d277c2b >Thread-483::DEBUG::2012-11-29 15:09:34,281::taskManager::166::TaskManager::(clearTask) Return. >Thread-483::INFO::2012-11-29 15:09:34,282::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-483::DEBUG::2012-11-29 15:09:34,282::task::1151::TaskManager.Task::(prepare) Task=`81fd575d-a8ce-46db-9fe6-1c2fd081f436`::finished: None >Thread-483::DEBUG::2012-11-29 15:09:34,282::task::568::TaskManager.Task::(_updateState) Task=`81fd575d-a8ce-46db-9fe6-1c2fd081f436`::moving from state preparing -> state finished >Thread-483::DEBUG::2012-11-29 15:09:34,282::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-483::DEBUG::2012-11-29 15:09:34,282::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-483::DEBUG::2012-11-29 15:09:34,282::task::957::TaskManager.Task::(_decref) Task=`81fd575d-a8ce-46db-9fe6-1c2fd081f436`::ref 0 aborting False >Thread-484::DEBUG::2012-11-29 15:09:34,323::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-484::DEBUG::2012-11-29 15:09:34,323::task::568::TaskManager.Task::(_updateState) Task=`9bb49a78-cb50-4ca7-a5fc-b262ebd24549`::moving from state init -> state preparing >Thread-484::INFO::2012-11-29 15:09:34,323::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-484::DEBUG::2012-11-29 15:09:34,324::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`04016f41-c23e-4e3f-bf3e-040679982426`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-484::DEBUG::2012-11-29 15:09:34,324::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-484::DEBUG::2012-11-29 15:09:34,324::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-484::DEBUG::2012-11-29 15:09:34,325::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`04016f41-c23e-4e3f-bf3e-040679982426`::Granted request >Thread-484::DEBUG::2012-11-29 15:09:34,325::task::794::TaskManager.Task::(resourceAcquired) Task=`9bb49a78-cb50-4ca7-a5fc-b262ebd24549`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-484::DEBUG::2012-11-29 15:09:34,325::task::957::TaskManager.Task::(_decref) Task=`9bb49a78-cb50-4ca7-a5fc-b262ebd24549`::ref 1 aborting False >Thread-484::DEBUG::2012-11-29 15:09:34,325::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`7777c908-8e6f-4de4-be39-7337c6c40300`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-484::DEBUG::2012-11-29 15:09:34,326::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'exclusive' >Thread-484::DEBUG::2012-11-29 15:09:34,326::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'exclusive' (1 active user) >Thread-484::DEBUG::2012-11-29 15:09:34,326::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`7777c908-8e6f-4de4-be39-7337c6c40300`::Granted request >Thread-484::DEBUG::2012-11-29 15:09:34,326::task::794::TaskManager.Task::(resourceAcquired) Task=`9bb49a78-cb50-4ca7-a5fc-b262ebd24549`::_resourcesAcquired: Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (exclusive) >Thread-484::DEBUG::2012-11-29 15:09:34,327::task::957::TaskManager.Task::(_decref) Task=`9bb49a78-cb50-4ca7-a5fc-b262ebd24549`::ref 1 aborting False >Thread-484::INFO::2012-11-29 15:09:34,327::sp::1045::Storage.StoragePool::(activateSD) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-484::INFO::2012-11-29 15:09:34,327::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-484::DEBUG::2012-11-29 15:09:34,327::task::1151::TaskManager.Task::(prepare) Task=`9bb49a78-cb50-4ca7-a5fc-b262ebd24549`::finished: None >Thread-484::DEBUG::2012-11-29 15:09:34,328::task::568::TaskManager.Task::(_updateState) Task=`9bb49a78-cb50-4ca7-a5fc-b262ebd24549`::moving from state preparing -> state finished >Thread-484::DEBUG::2012-11-29 15:09:34,328::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1': < ResourceRef 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', isValid: 'True' obj: 'None'>} >Thread-484::DEBUG::2012-11-29 15:09:34,328::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-484::DEBUG::2012-11-29 15:09:34,328::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-484::DEBUG::2012-11-29 15:09:34,328::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-484::DEBUG::2012-11-29 15:09:34,329::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-484::DEBUG::2012-11-29 15:09:34,329::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-484::DEBUG::2012-11-29 15:09:34,329::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >Thread-484::DEBUG::2012-11-29 15:09:34,329::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >Thread-484::DEBUG::2012-11-29 15:09:34,329::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >Thread-484::DEBUG::2012-11-29 15:09:34,330::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >Thread-484::DEBUG::2012-11-29 15:09:34,330::task::957::TaskManager.Task::(_decref) Task=`9bb49a78-cb50-4ca7-a5fc-b262ebd24549`::ref 0 aborting False >Thread-485::DEBUG::2012-11-29 15:09:34,382::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-485::DEBUG::2012-11-29 15:09:34,383::task::568::TaskManager.Task::(_updateState) Task=`d6d693ca-915a-4144-8ed7-d12326d30ff7`::moving from state init -> state preparing >Thread-485::INFO::2012-11-29 15:09:34,383::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', hostID=1, scsiKey='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-485::DEBUG::2012-11-29 15:09:34,383::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`da3ad969-b411-4da3-9335-5bb93c94ab01`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-485::DEBUG::2012-11-29 15:09:34,384::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-485::DEBUG::2012-11-29 15:09:34,384::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-485::DEBUG::2012-11-29 15:09:34,384::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`da3ad969-b411-4da3-9335-5bb93c94ab01`::Granted request >Thread-485::DEBUG::2012-11-29 15:09:34,385::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-485::DEBUG::2012-11-29 15:09:34,385::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-485::DEBUG::2012-11-29 15:09:34,385::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-485::DEBUG::2012-11-29 15:09:34,385::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-485::DEBUG::2012-11-29 15:09:34,385::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-485::INFO::2012-11-29 15:09:34,386::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: None >Thread-485::DEBUG::2012-11-29 15:09:34,386::task::1151::TaskManager.Task::(prepare) Task=`d6d693ca-915a-4144-8ed7-d12326d30ff7`::finished: None >Thread-485::DEBUG::2012-11-29 15:09:34,386::task::568::TaskManager.Task::(_updateState) Task=`d6d693ca-915a-4144-8ed7-d12326d30ff7`::moving from state preparing -> state finished >Thread-485::DEBUG::2012-11-29 15:09:34,386::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-485::DEBUG::2012-11-29 15:09:34,386::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-485::DEBUG::2012-11-29 15:09:34,386::task::957::TaskManager.Task::(_decref) Task=`d6d693ca-915a-4144-8ed7-d12326d30ff7`::ref 0 aborting False >Thread-486::DEBUG::2012-11-29 15:09:34,580::task::568::TaskManager.Task::(_updateState) Task=`40e28f9e-d5e2-47e7-8b47-89baa8354305`::moving from state init -> state preparing >Thread-486::INFO::2012-11-29 15:09:34,580::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-486::INFO::2012-11-29 15:09:34,580::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00221991539001', 'lastCheck': '1.0', 'code': 0, 'valid': True}} >Thread-486::DEBUG::2012-11-29 15:09:34,580::task::1151::TaskManager.Task::(prepare) Task=`40e28f9e-d5e2-47e7-8b47-89baa8354305`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00221991539001', 'lastCheck': '1.0', 'code': 0, 'valid': True}} >Thread-486::DEBUG::2012-11-29 15:09:34,581::task::568::TaskManager.Task::(_updateState) Task=`40e28f9e-d5e2-47e7-8b47-89baa8354305`::moving from state preparing -> state finished >Thread-486::DEBUG::2012-11-29 15:09:34,581::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-486::DEBUG::2012-11-29 15:09:34,581::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-486::DEBUG::2012-11-29 15:09:34,581::task::957::TaskManager.Task::(_decref) Task=`40e28f9e-d5e2-47e7-8b47-89baa8354305`::ref 0 aborting False >Thread-489::DEBUG::2012-11-29 15:09:36,866::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-489::DEBUG::2012-11-29 15:09:36,866::task::568::TaskManager.Task::(_updateState) Task=`e7efdeff-b3cb-4e9b-9969-607aedaeb8eb`::moving from state init -> state preparing >Thread-489::INFO::2012-11-29 15:09:36,866::logUtils::37::dispatcher::(wrapper) Run and protect: setStorageDomainDescription(sdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', description='DataDomainRestUpd', options=None) >Thread-489::DEBUG::2012-11-29 15:09:36,867::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`873503ca-5c51-48ce-b719-5318a9b065bb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-489::DEBUG::2012-11-29 15:09:36,867::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'exclusive' >Thread-489::DEBUG::2012-11-29 15:09:36,867::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'exclusive' (1 active user) >Thread-489::DEBUG::2012-11-29 15:09:36,867::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`873503ca-5c51-48ce-b719-5318a9b065bb`::Granted request >Thread-489::DEBUG::2012-11-29 15:09:36,868::task::794::TaskManager.Task::(resourceAcquired) Task=`e7efdeff-b3cb-4e9b-9969-607aedaeb8eb`::_resourcesAcquired: Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (exclusive) >Thread-489::DEBUG::2012-11-29 15:09:36,868::task::957::TaskManager.Task::(_decref) Task=`e7efdeff-b3cb-4e9b-9969-607aedaeb8eb`::ref 1 aborting False >Thread-489::INFO::2012-11-29 15:09:36,868::sd::647::Storage.StorageDomain::(setDescription) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 descr=DataDomainRestUpd >Thread-489::DEBUG::2012-11-29 15:09:36,868::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-489::DEBUG::2012-11-29 15:09:36,868::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-489::DEBUG::2012-11-29 15:09:36,869::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5d93bd966b3139ba2a97b71863479fd1506d2da7'] >Thread-489::DEBUG::2012-11-29 15:09:36,872::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-489::INFO::2012-11-29 15:09:36,872::logUtils::39::dispatcher::(wrapper) Run and protect: setStorageDomainDescription, Return response: None >Thread-489::DEBUG::2012-11-29 15:09:36,872::task::1151::TaskManager.Task::(prepare) Task=`e7efdeff-b3cb-4e9b-9969-607aedaeb8eb`::finished: None >Thread-489::DEBUG::2012-11-29 15:09:36,873::task::568::TaskManager.Task::(_updateState) Task=`e7efdeff-b3cb-4e9b-9969-607aedaeb8eb`::moving from state preparing -> state finished >Thread-489::DEBUG::2012-11-29 15:09:36,873::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1': < ResourceRef 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', isValid: 'True' obj: 'None'>} >Thread-489::DEBUG::2012-11-29 15:09:36,873::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-489::DEBUG::2012-11-29 15:09:36,873::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >Thread-489::DEBUG::2012-11-29 15:09:36,873::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >Thread-489::DEBUG::2012-11-29 15:09:36,873::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >Thread-489::DEBUG::2012-11-29 15:09:36,874::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >Thread-489::DEBUG::2012-11-29 15:09:36,874::task::957::TaskManager.Task::(_decref) Task=`e7efdeff-b3cb-4e9b-9969-607aedaeb8eb`::ref 0 aborting False >Thread-491::DEBUG::2012-11-29 15:09:38,851::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-491::DEBUG::2012-11-29 15:09:38,852::task::568::TaskManager.Task::(_updateState) Task=`4c3f4868-c3d3-454b-b100-e9fd123df9dc`::moving from state init -> state preparing >Thread-491::INFO::2012-11-29 15:09:38,852::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-491::INFO::2012-11-29 15:09:38,852::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-491::DEBUG::2012-11-29 15:09:38,852::task::1151::TaskManager.Task::(prepare) Task=`4c3f4868-c3d3-454b-b100-e9fd123df9dc`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-491::DEBUG::2012-11-29 15:09:38,853::task::568::TaskManager.Task::(_updateState) Task=`4c3f4868-c3d3-454b-b100-e9fd123df9dc`::moving from state preparing -> state finished >Thread-491::DEBUG::2012-11-29 15:09:38,853::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-491::DEBUG::2012-11-29 15:09:38,853::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-491::DEBUG::2012-11-29 15:09:38,853::task::957::TaskManager.Task::(_decref) Task=`4c3f4868-c3d3-454b-b100-e9fd123df9dc`::ref 0 aborting False >Thread-492::DEBUG::2012-11-29 15:09:38,889::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-492::DEBUG::2012-11-29 15:09:38,890::task::568::TaskManager.Task::(_updateState) Task=`fbcda673-f8fb-47a6-8edf-e97c7ee7b0d1`::moving from state init -> state preparing >Thread-492::INFO::2012-11-29 15:09:38,890::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-492::DEBUG::2012-11-29 15:09:38,892::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301' (cwd None) >Thread-492::INFO::2012-11-29 15:09:38,921::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-492::DEBUG::2012-11-29 15:09:38,921::task::1151::TaskManager.Task::(prepare) Task=`fbcda673-f8fb-47a6-8edf-e97c7ee7b0d1`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-492::DEBUG::2012-11-29 15:09:38,921::task::568::TaskManager.Task::(_updateState) Task=`fbcda673-f8fb-47a6-8edf-e97c7ee7b0d1`::moving from state preparing -> state finished >Thread-492::DEBUG::2012-11-29 15:09:38,921::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-492::DEBUG::2012-11-29 15:09:38,922::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-492::DEBUG::2012-11-29 15:09:38,922::task::957::TaskManager.Task::(_decref) Task=`fbcda673-f8fb-47a6-8edf-e97c7ee7b0d1`::ref 0 aborting False >Thread-493::DEBUG::2012-11-29 15:09:38,962::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-493::DEBUG::2012-11-29 15:09:38,962::task::568::TaskManager.Task::(_updateState) Task=`d89274fe-c565-4b7c-995c-011eb0888bd2`::moving from state init -> state preparing >Thread-493::INFO::2012-11-29 15:09:38,963::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=2, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', options=None) >Thread-493::DEBUG::2012-11-29 15:09:38,963::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-493::DEBUG::2012-11-29 15:09:38,963::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-493::DEBUG::2012-11-29 15:09:38,963::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-493::DEBUG::2012-11-29 15:09:38,963::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-493::DEBUG::2012-11-29 15:09:38,964::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-493::DEBUG::2012-11-29 15:09:38,978::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-493::DEBUG::2012-11-29 15:09:38,978::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-493::DEBUG::2012-11-29 15:09:38,980::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-493::DEBUG::2012-11-29 15:09:38,983::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-493::DEBUG::2012-11-29 15:09:38,985::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-493::DEBUG::2012-11-29 15:09:38,987::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-493::DEBUG::2012-11-29 15:09:38,989::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-493::DEBUG::2012-11-29 15:09:38,991::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-493::DEBUG::2012-11-29 15:09:38,993::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-493::DEBUG::2012-11-29 15:09:38,995::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-493::DEBUG::2012-11-29 15:09:40,998::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-493::DEBUG::2012-11-29 15:09:41,047::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-493::DEBUG::2012-11-29 15:09:41,048::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-493::DEBUG::2012-11-29 15:09:41,048::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-493::DEBUG::2012-11-29 15:09:41,048::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-493::DEBUG::2012-11-29 15:09:41,048::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-493::DEBUG::2012-11-29 15:09:41,049::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-493::DEBUG::2012-11-29 15:09:41,049::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-493::DEBUG::2012-11-29 15:09:41,049::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-493::DEBUG::2012-11-29 15:09:41,050::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-493::DEBUG::2012-11-29 15:09:41,051::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-493::DEBUG::2012-11-29 15:09:41,199::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-493::DEBUG::2012-11-29 15:09:41,199::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-493::INFO::2012-11-29 15:09:41,266::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-493::DEBUG::2012-11-29 15:09:41,266::task::1151::TaskManager.Task::(prepare) Task=`d89274fe-c565-4b7c-995c-011eb0888bd2`::finished: {'domlist': []} >Thread-493::DEBUG::2012-11-29 15:09:41,266::task::568::TaskManager.Task::(_updateState) Task=`d89274fe-c565-4b7c-995c-011eb0888bd2`::moving from state preparing -> state finished >Thread-493::DEBUG::2012-11-29 15:09:41,266::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-493::DEBUG::2012-11-29 15:09:41,267::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-493::DEBUG::2012-11-29 15:09:41,267::task::957::TaskManager.Task::(_decref) Task=`d89274fe-c565-4b7c-995c-011eb0888bd2`::ref 0 aborting False >Thread-497::DEBUG::2012-11-29 15:09:42,356::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-497::DEBUG::2012-11-29 15:09:42,356::task::568::TaskManager.Task::(_updateState) Task=`36557035-864f-4f68-8236-cfe7f433a2ea`::moving from state init -> state preparing >Thread-497::INFO::2012-11-29 15:09:42,356::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-497::INFO::2012-11-29 15:09:42,356::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-497::DEBUG::2012-11-29 15:09:42,357::task::1151::TaskManager.Task::(prepare) Task=`36557035-864f-4f68-8236-cfe7f433a2ea`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-497::DEBUG::2012-11-29 15:09:42,357::task::568::TaskManager.Task::(_updateState) Task=`36557035-864f-4f68-8236-cfe7f433a2ea`::moving from state preparing -> state finished >Thread-497::DEBUG::2012-11-29 15:09:42,357::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-497::DEBUG::2012-11-29 15:09:42,357::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-497::DEBUG::2012-11-29 15:09:42,357::task::957::TaskManager.Task::(_decref) Task=`36557035-864f-4f68-8236-cfe7f433a2ea`::ref 0 aborting False >Thread-498::DEBUG::2012-11-29 15:09:42,393::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-498::DEBUG::2012-11-29 15:09:42,393::task::568::TaskManager.Task::(_updateState) Task=`eaa668c4-e288-4a76-bf6c-689d4f9978e3`::moving from state init -> state preparing >Thread-498::INFO::2012-11-29 15:09:42,394::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3', 'port': ''}], options=None) >Thread-498::INFO::2012-11-29 15:09:42,396::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-498::DEBUG::2012-11-29 15:09:42,396::task::1151::TaskManager.Task::(prepare) Task=`eaa668c4-e288-4a76-bf6c-689d4f9978e3`::finished: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-498::DEBUG::2012-11-29 15:09:42,396::task::568::TaskManager.Task::(_updateState) Task=`eaa668c4-e288-4a76-bf6c-689d4f9978e3`::moving from state preparing -> state finished >Thread-498::DEBUG::2012-11-29 15:09:42,397::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-498::DEBUG::2012-11-29 15:09:42,397::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-498::DEBUG::2012-11-29 15:09:42,397::task::957::TaskManager.Task::(_decref) Task=`eaa668c4-e288-4a76-bf6c-689d4f9978e3`::ref 0 aborting False >Thread-499::DEBUG::2012-11-29 15:09:42,432::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-499::DEBUG::2012-11-29 15:09:42,433::task::568::TaskManager.Task::(_updateState) Task=`ac41b221-47aa-4e07-bd90-c4201cb0912b`::moving from state init -> state preparing >Thread-499::INFO::2012-11-29 15:09:42,433::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=2, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', options=None) >Thread-499::DEBUG::2012-11-29 15:09:42,433::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-499::DEBUG::2012-11-29 15:09:42,433::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-499::DEBUG::2012-11-29 15:09:42,433::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-499::DEBUG::2012-11-29 15:09:42,434::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-499::DEBUG::2012-11-29 15:09:42,434::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-499::DEBUG::2012-11-29 15:09:42,447::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-499::DEBUG::2012-11-29 15:09:42,448::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-499::DEBUG::2012-11-29 15:09:42,449::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-499::DEBUG::2012-11-29 15:09:42,452::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-499::DEBUG::2012-11-29 15:09:42,454::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-499::DEBUG::2012-11-29 15:09:42,456::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-499::DEBUG::2012-11-29 15:09:42,458::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-499::DEBUG::2012-11-29 15:09:42,460::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-499::DEBUG::2012-11-29 15:09:42,462::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-499::DEBUG::2012-11-29 15:09:42,464::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-501::DEBUG::2012-11-29 15:09:44,361::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-501::DEBUG::2012-11-29 15:09:44,361::task::568::TaskManager.Task::(_updateState) Task=`ffb6a135-fafa-49e8-861e-e428a58817af`::moving from state init -> state preparing >Thread-501::INFO::2012-11-29 15:09:44,362::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-501::INFO::2012-11-29 15:09:44,362::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-501::DEBUG::2012-11-29 15:09:44,362::task::1151::TaskManager.Task::(prepare) Task=`ffb6a135-fafa-49e8-861e-e428a58817af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-501::DEBUG::2012-11-29 15:09:44,362::task::568::TaskManager.Task::(_updateState) Task=`ffb6a135-fafa-49e8-861e-e428a58817af`::moving from state preparing -> state finished >Thread-501::DEBUG::2012-11-29 15:09:44,362::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-501::DEBUG::2012-11-29 15:09:44,363::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-501::DEBUG::2012-11-29 15:09:44,363::task::957::TaskManager.Task::(_decref) Task=`ffb6a135-fafa-49e8-861e-e428a58817af`::ref 0 aborting False >Thread-502::DEBUG::2012-11-29 15:09:44,391::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-502::DEBUG::2012-11-29 15:09:44,392::task::568::TaskManager.Task::(_updateState) Task=`67392f26-91ae-4cf8-9101-8e6d15bc6439`::moving from state init -> state preparing >Thread-502::INFO::2012-11-29 15:09:44,392::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-502::DEBUG::2012-11-29 15:09:44,393::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`bf531245-ce9e-459d-97eb-a096b819d4bc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-502::DEBUG::2012-11-29 15:09:44,393::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-502::DEBUG::2012-11-29 15:09:44,393::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-502::DEBUG::2012-11-29 15:09:44,393::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`bf531245-ce9e-459d-97eb-a096b819d4bc`::Granted request >Thread-502::DEBUG::2012-11-29 15:09:44,394::task::794::TaskManager.Task::(resourceAcquired) Task=`67392f26-91ae-4cf8-9101-8e6d15bc6439`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-502::DEBUG::2012-11-29 15:09:44,394::task::957::TaskManager.Task::(_decref) Task=`67392f26-91ae-4cf8-9101-8e6d15bc6439`::ref 1 aborting False >Thread-502::INFO::2012-11-29 15:09:44,396::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861058105344', 'alerts': [], 'disktotal': '861060202496'}}} >Thread-502::DEBUG::2012-11-29 15:09:44,396::task::1151::TaskManager.Task::(prepare) Task=`67392f26-91ae-4cf8-9101-8e6d15bc6439`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861058105344', 'alerts': [], 'disktotal': '861060202496'}}} >Thread-502::DEBUG::2012-11-29 15:09:44,396::task::568::TaskManager.Task::(_updateState) Task=`67392f26-91ae-4cf8-9101-8e6d15bc6439`::moving from state preparing -> state finished >Thread-502::DEBUG::2012-11-29 15:09:44,397::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-502::DEBUG::2012-11-29 15:09:44,397::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-502::DEBUG::2012-11-29 15:09:44,397::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-502::DEBUG::2012-11-29 15:09:44,397::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-502::DEBUG::2012-11-29 15:09:44,397::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-502::DEBUG::2012-11-29 15:09:44,398::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-502::DEBUG::2012-11-29 15:09:44,398::task::957::TaskManager.Task::(_decref) Task=`67392f26-91ae-4cf8-9101-8e6d15bc6439`::ref 0 aborting False >Thread-499::DEBUG::2012-11-29 15:09:44,467::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-499::DEBUG::2012-11-29 15:09:44,513::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-499::DEBUG::2012-11-29 15:09:44,514::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-499::DEBUG::2012-11-29 15:09:44,514::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-499::DEBUG::2012-11-29 15:09:44,514::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-499::DEBUG::2012-11-29 15:09:44,514::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-499::DEBUG::2012-11-29 15:09:44,515::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-499::DEBUG::2012-11-29 15:09:44,515::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-499::DEBUG::2012-11-29 15:09:44,515::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-499::DEBUG::2012-11-29 15:09:44,516::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-499::DEBUG::2012-11-29 15:09:44,517::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-499::DEBUG::2012-11-29 15:09:44,661::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-499::DEBUG::2012-11-29 15:09:44,662::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-499::INFO::2012-11-29 15:09:44,666::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-499::DEBUG::2012-11-29 15:09:44,667::task::1151::TaskManager.Task::(prepare) Task=`ac41b221-47aa-4e07-bd90-c4201cb0912b`::finished: {'domlist': []} >Thread-499::DEBUG::2012-11-29 15:09:44,667::task::568::TaskManager.Task::(_updateState) Task=`ac41b221-47aa-4e07-bd90-c4201cb0912b`::moving from state preparing -> state finished >Thread-499::DEBUG::2012-11-29 15:09:44,667::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-499::DEBUG::2012-11-29 15:09:44,667::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-499::DEBUG::2012-11-29 15:09:44,668::task::957::TaskManager.Task::(_decref) Task=`ac41b221-47aa-4e07-bd90-c4201cb0912b`::ref 0 aborting False >Thread-505::DEBUG::2012-11-29 15:09:44,738::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-505::DEBUG::2012-11-29 15:09:44,738::task::568::TaskManager.Task::(_updateState) Task=`02785da0-9b6e-47e6-89e1-cfd94554ca5e`::moving from state init -> state preparing >Thread-505::INFO::2012-11-29 15:09:44,739::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', domainName='ISODomainRest', typeSpecificArg='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', domClass=2, domVersion='0', options=None) >Thread-505::DEBUG::2012-11-29 15:09:44,739::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-505::DEBUG::2012-11-29 15:09:44,740::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8b0589fb-75aa-4da8-bd44-c57742910be4' (cwd None) >Thread-506::DEBUG::2012-11-29 15:09:44,789::task::568::TaskManager.Task::(_updateState) Task=`6e42b114-9ee9-4aef-8411-c026148c3e70`::moving from state init -> state preparing >Thread-506::INFO::2012-11-29 15:09:44,790::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-506::INFO::2012-11-29 15:09:44,790::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00223898887634', 'lastCheck': '1.2', 'code': 0, 'valid': True}} >Thread-506::DEBUG::2012-11-29 15:09:44,790::task::1151::TaskManager.Task::(prepare) Task=`6e42b114-9ee9-4aef-8411-c026148c3e70`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00223898887634', 'lastCheck': '1.2', 'code': 0, 'valid': True}} >Thread-506::DEBUG::2012-11-29 15:09:44,790::task::568::TaskManager.Task::(_updateState) Task=`6e42b114-9ee9-4aef-8411-c026148c3e70`::moving from state preparing -> state finished >Thread-506::DEBUG::2012-11-29 15:09:44,791::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-506::DEBUG::2012-11-29 15:09:44,791::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-506::DEBUG::2012-11-29 15:09:44,791::task::957::TaskManager.Task::(_decref) Task=`6e42b114-9ee9-4aef-8411-c026148c3e70`::ref 0 aborting False >Thread-505::DEBUG::2012-11-29 15:09:44,890::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found\n'; <rc> = 5 >Thread-505::WARNING::2012-11-29 15:09:44,891::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found'] >Thread-505::DEBUG::2012-11-29 15:09:44,891::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-505::INFO::2012-11-29 15:09:44,895::nfsSD::68::Storage.StorageDomain::(create) sdUUID=8b0589fb-75aa-4da8-bd44-c57742910be4 domainName=ISODomainRest remotePath=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301 domClass=2 >Thread-505::DEBUG::2012-11-29 15:09:45,042::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-505::DEBUG::2012-11-29 15:09:45,043::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-505::WARNING::2012-11-29 15:09:45,043::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-505::DEBUG::2012-11-29 15:09:45,043::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-505::DEBUG::2012-11-29 15:09:45,044::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-505::DEBUG::2012-11-29 15:09:45,044::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a617bdef49db953a2add25751342088d4a830dcf'] >Thread-505::DEBUG::2012-11-29 15:09:45,047::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-505::DEBUG::2012-11-29 15:09:45,049::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-505::DEBUG::2012-11-29 15:09:45,049::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-505::DEBUG::2012-11-29 15:09:45,052::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a617bdef49db953a2add25751342088d4a830dcf'] >Thread-505::DEBUG::2012-11-29 15:09:45,054::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-505::DEBUG::2012-11-29 15:09:45,054::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '8b0589fb-75aa-4da8-bd44-c57742910be4_imageNS' >Thread-505::DEBUG::2012-11-29 15:09:45,055::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '8b0589fb-75aa-4da8-bd44-c57742910be4_volumeNS' >Thread-505::DEBUG::2012-11-29 15:09:45,055::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-505::DEBUG::2012-11-29 15:09:45,061::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-505::DEBUG::2012-11-29 15:09:45,061::sd::396::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-505::INFO::2012-11-29 15:09:45,061::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-505::DEBUG::2012-11-29 15:09:45,061::task::1151::TaskManager.Task::(prepare) Task=`02785da0-9b6e-47e6-89e1-cfd94554ca5e`::finished: None >Thread-505::DEBUG::2012-11-29 15:09:45,062::task::568::TaskManager.Task::(_updateState) Task=`02785da0-9b6e-47e6-89e1-cfd94554ca5e`::moving from state preparing -> state finished >Thread-505::DEBUG::2012-11-29 15:09:45,062::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-505::DEBUG::2012-11-29 15:09:45,062::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-505::DEBUG::2012-11-29 15:09:45,062::task::957::TaskManager.Task::(_decref) Task=`02785da0-9b6e-47e6-89e1-cfd94554ca5e`::ref 0 aborting False >Thread-510::DEBUG::2012-11-29 15:09:45,090::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-510::DEBUG::2012-11-29 15:09:45,090::task::568::TaskManager.Task::(_updateState) Task=`a489e18c-4650-4cd0-bd09-7c55efb2fb90`::moving from state init -> state preparing >Thread-510::INFO::2012-11-29 15:09:45,091::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', options=None) >Thread-510::DEBUG::2012-11-29 15:09:45,091::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`e6710dcd-3bd5-4c29-a182-4d679a7a2727`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-510::DEBUG::2012-11-29 15:09:45,091::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'shared' >Thread-510::DEBUG::2012-11-29 15:09:45,092::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'shared' (1 active user) >Thread-510::DEBUG::2012-11-29 15:09:45,092::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`e6710dcd-3bd5-4c29-a182-4d679a7a2727`::Granted request >Thread-510::DEBUG::2012-11-29 15:09:45,092::task::794::TaskManager.Task::(resourceAcquired) Task=`a489e18c-4650-4cd0-bd09-7c55efb2fb90`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (shared) >Thread-510::DEBUG::2012-11-29 15:09:45,092::task::957::TaskManager.Task::(_decref) Task=`a489e18c-4650-4cd0-bd09-7c55efb2fb90`::ref 1 aborting False >Thread-510::INFO::2012-11-29 15:09:45,094::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861056008192', 'disktotal': '861056008192', 'mdafree': 0}} >Thread-510::DEBUG::2012-11-29 15:09:45,094::task::1151::TaskManager.Task::(prepare) Task=`a489e18c-4650-4cd0-bd09-7c55efb2fb90`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861056008192', 'disktotal': '861056008192', 'mdafree': 0}} >Thread-510::DEBUG::2012-11-29 15:09:45,094::task::568::TaskManager.Task::(_updateState) Task=`a489e18c-4650-4cd0-bd09-7c55efb2fb90`::moving from state preparing -> state finished >Thread-510::DEBUG::2012-11-29 15:09:45,094::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-510::DEBUG::2012-11-29 15:09:45,094::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-510::DEBUG::2012-11-29 15:09:45,095::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-510::DEBUG::2012-11-29 15:09:45,095::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-510::DEBUG::2012-11-29 15:09:45,095::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-510::DEBUG::2012-11-29 15:09:45,095::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-510::DEBUG::2012-11-29 15:09:45,095::task::957::TaskManager.Task::(_decref) Task=`a489e18c-4650-4cd0-bd09-7c55efb2fb90`::ref 0 aborting False >Thread-511::DEBUG::2012-11-29 15:09:46,123::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-511::DEBUG::2012-11-29 15:09:46,123::task::568::TaskManager.Task::(_updateState) Task=`2e6082bf-2a8e-489c-834b-bab06277976f`::moving from state init -> state preparing >Thread-511::INFO::2012-11-29 15:09:46,123::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '751c3b23-d629-4309-b2a9-4435f5f82959', 'port': ''}], options=None) >Thread-511::INFO::2012-11-29 15:09:46,124::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-511::DEBUG::2012-11-29 15:09:46,124::task::1151::TaskManager.Task::(prepare) Task=`2e6082bf-2a8e-489c-834b-bab06277976f`::finished: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-511::DEBUG::2012-11-29 15:09:46,124::task::568::TaskManager.Task::(_updateState) Task=`2e6082bf-2a8e-489c-834b-bab06277976f`::moving from state preparing -> state finished >Thread-511::DEBUG::2012-11-29 15:09:46,124::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-511::DEBUG::2012-11-29 15:09:46,124::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-511::DEBUG::2012-11-29 15:09:46,124::task::957::TaskManager.Task::(_decref) Task=`2e6082bf-2a8e-489c-834b-bab06277976f`::ref 0 aborting False >Thread-512::DEBUG::2012-11-29 15:09:46,152::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-512::DEBUG::2012-11-29 15:09:46,152::task::568::TaskManager.Task::(_updateState) Task=`ecdb212d-5866-4aff-bdfd-49be636237ab`::moving from state init -> state preparing >Thread-512::INFO::2012-11-29 15:09:46,153::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '751c3b23-d629-4309-b2a9-4435f5f82959', 'port': ''}], options=None) >Thread-512::INFO::2012-11-29 15:09:46,155::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-512::DEBUG::2012-11-29 15:09:46,155::task::1151::TaskManager.Task::(prepare) Task=`ecdb212d-5866-4aff-bdfd-49be636237ab`::finished: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-512::DEBUG::2012-11-29 15:09:46,155::task::568::TaskManager.Task::(_updateState) Task=`ecdb212d-5866-4aff-bdfd-49be636237ab`::moving from state preparing -> state finished >Thread-512::DEBUG::2012-11-29 15:09:46,155::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-512::DEBUG::2012-11-29 15:09:46,155::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-512::DEBUG::2012-11-29 15:09:46,155::task::957::TaskManager.Task::(_decref) Task=`ecdb212d-5866-4aff-bdfd-49be636237ab`::ref 0 aborting False >Thread-513::DEBUG::2012-11-29 15:09:46,182::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-513::DEBUG::2012-11-29 15:09:46,183::task::568::TaskManager.Task::(_updateState) Task=`b8f4ec5f-9b51-4d26-b821-45229b8d2342`::moving from state init -> state preparing >Thread-513::INFO::2012-11-29 15:09:46,183::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-513::DEBUG::2012-11-29 15:09:46,183::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`0c8a17e9-fce7-43fd-a2c5-da6268a1d619`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-513::DEBUG::2012-11-29 15:09:46,183::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-513::DEBUG::2012-11-29 15:09:46,184::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-513::DEBUG::2012-11-29 15:09:46,184::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`0c8a17e9-fce7-43fd-a2c5-da6268a1d619`::Granted request >Thread-513::DEBUG::2012-11-29 15:09:46,184::task::794::TaskManager.Task::(resourceAcquired) Task=`b8f4ec5f-9b51-4d26-b821-45229b8d2342`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-513::DEBUG::2012-11-29 15:09:46,184::task::957::TaskManager.Task::(_decref) Task=`b8f4ec5f-9b51-4d26-b821-45229b8d2342`::ref 1 aborting False >Thread-513::DEBUG::2012-11-29 15:09:46,184::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`4781f2fc-a8e0-4cd3-8e88-ad8ec336a507`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-513::DEBUG::2012-11-29 15:09:46,185::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'exclusive' >Thread-513::DEBUG::2012-11-29 15:09:46,185::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'exclusive' (1 active user) >Thread-513::DEBUG::2012-11-29 15:09:46,185::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`4781f2fc-a8e0-4cd3-8e88-ad8ec336a507`::Granted request >Thread-513::DEBUG::2012-11-29 15:09:46,185::task::794::TaskManager.Task::(resourceAcquired) Task=`b8f4ec5f-9b51-4d26-b821-45229b8d2342`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (exclusive) >Thread-513::DEBUG::2012-11-29 15:09:46,185::task::957::TaskManager.Task::(_decref) Task=`b8f4ec5f-9b51-4d26-b821-45229b8d2342`::ref 1 aborting False >Thread-513::INFO::2012-11-29 15:09:46,186::sp::918::Storage.StoragePool::(attachSD) sdUUID=8b0589fb-75aa-4da8-bd44-c57742910be4 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-513::DEBUG::2012-11-29 15:09:46,188::safelease::94::ClusterLock::(acquire) Acquiring cluster lock for domain 8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-513::DEBUG::2012-11-29 15:09:46,188::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c1 -n0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 8b0589fb-75aa-4da8-bd44-c57742910be4 1 5 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-513::DEBUG::2012-11-29 15:09:48,219::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-513::DEBUG::2012-11-29 15:09:48,219::safelease::109::ClusterLock::(acquire) Clustered lock acquired successfully >Thread-513::DEBUG::2012-11-29 15:09:48,223::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a617bdef49db953a2add25751342088d4a830dcf'] >Thread-513::DEBUG::2012-11-29 15:09:48,223::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-513::DEBUG::2012-11-29 15:09:48,223::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-513::DEBUG::2012-11-29 15:09:48,223::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=57efc76b480121ba1def7f48630b84f35b807e19'] >Thread-513::DEBUG::2012-11-29 15:09:48,227::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-513::DEBUG::2012-11-29 15:09:48,227::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-513::DEBUG::2012-11-29 15:09:48,227::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-513::DEBUG::2012-11-29 15:09:48,227::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9af281c297533c54610537f921129be9e3a04c95'] >Thread-513::DEBUG::2012-11-29 15:09:48,230::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-513::INFO::2012-11-29 15:09:48,231::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-513::DEBUG::2012-11-29 15:09:48,231::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-513::DEBUG::2012-11-29 15:09:48,231::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-513::DEBUG::2012-11-29 15:09:48,232::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-513::DEBUG::2012-11-29 15:09:48,232::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-513::DEBUG::2012-11-29 15:09:48,232::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=fcbd35a59c29b923dccdd6639a0a0b82265883b2'] >Thread-513::DEBUG::2012-11-29 15:09:48,235::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-513::INFO::2012-11-29 15:09:48,235::safelease::119::ClusterLock::(release) Releasing cluster lock for domain 8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-513::DEBUG::2012-11-29 15:09:48,235::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 8b0589fb-75aa-4da8-bd44-c57742910be4' (cwd /usr/libexec/vdsm) >Thread-513::DEBUG::2012-11-29 15:09:49,315::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-513::DEBUG::2012-11-29 15:09:49,315::safelease::126::ClusterLock::(release) Cluster lock released successfully >Thread-513::DEBUG::2012-11-29 15:09:49,316::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-513::DEBUG::2012-11-29 15:09:49,316::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-513::DEBUG::2012-11-29 15:09:49,316::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-513::INFO::2012-11-29 15:09:49,316::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-513::DEBUG::2012-11-29 15:09:49,316::task::1151::TaskManager.Task::(prepare) Task=`b8f4ec5f-9b51-4d26-b821-45229b8d2342`::finished: None >Thread-513::DEBUG::2012-11-29 15:09:49,317::task::568::TaskManager.Task::(_updateState) Task=`b8f4ec5f-9b51-4d26-b821-45229b8d2342`::moving from state preparing -> state finished >Thread-513::DEBUG::2012-11-29 15:09:49,317::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-513::DEBUG::2012-11-29 15:09:49,317::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-513::DEBUG::2012-11-29 15:09:49,317::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-513::DEBUG::2012-11-29 15:09:49,318::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-513::DEBUG::2012-11-29 15:09:49,318::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-513::DEBUG::2012-11-29 15:09:49,318::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-513::DEBUG::2012-11-29 15:09:49,318::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-513::DEBUG::2012-11-29 15:09:49,319::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-513::DEBUG::2012-11-29 15:09:49,319::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-513::DEBUG::2012-11-29 15:09:49,319::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-513::DEBUG::2012-11-29 15:09:49,319::task::957::TaskManager.Task::(_decref) Task=`b8f4ec5f-9b51-4d26-b821-45229b8d2342`::ref 0 aborting False >Thread-517::DEBUG::2012-11-29 15:09:50,987::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-517::DEBUG::2012-11-29 15:09:50,987::task::568::TaskManager.Task::(_updateState) Task=`39a5672e-d181-4ed1-9ada-8dbf913dd243`::moving from state init -> state preparing >Thread-517::INFO::2012-11-29 15:09:50,987::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '751c3b23-d629-4309-b2a9-4435f5f82959', 'port': ''}], options=None) >Thread-517::INFO::2012-11-29 15:09:50,988::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-517::DEBUG::2012-11-29 15:09:50,988::task::1151::TaskManager.Task::(prepare) Task=`39a5672e-d181-4ed1-9ada-8dbf913dd243`::finished: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-517::DEBUG::2012-11-29 15:09:50,988::task::568::TaskManager.Task::(_updateState) Task=`39a5672e-d181-4ed1-9ada-8dbf913dd243`::moving from state preparing -> state finished >Thread-517::DEBUG::2012-11-29 15:09:50,988::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-517::DEBUG::2012-11-29 15:09:50,988::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-517::DEBUG::2012-11-29 15:09:50,989::task::957::TaskManager.Task::(_decref) Task=`39a5672e-d181-4ed1-9ada-8dbf913dd243`::ref 0 aborting False >Thread-518::DEBUG::2012-11-29 15:09:51,020::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-518::DEBUG::2012-11-29 15:09:51,021::task::568::TaskManager.Task::(_updateState) Task=`2ddc4eb2-0f10-459e-be3f-edaef96d294f`::moving from state init -> state preparing >Thread-518::INFO::2012-11-29 15:09:51,021::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '751c3b23-d629-4309-b2a9-4435f5f82959', 'port': ''}], options=None) >Thread-518::INFO::2012-11-29 15:09:51,023::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-518::DEBUG::2012-11-29 15:09:51,024::task::1151::TaskManager.Task::(prepare) Task=`2ddc4eb2-0f10-459e-be3f-edaef96d294f`::finished: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-518::DEBUG::2012-11-29 15:09:51,024::task::568::TaskManager.Task::(_updateState) Task=`2ddc4eb2-0f10-459e-be3f-edaef96d294f`::moving from state preparing -> state finished >Thread-518::DEBUG::2012-11-29 15:09:51,024::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-518::DEBUG::2012-11-29 15:09:51,024::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-518::DEBUG::2012-11-29 15:09:51,024::task::957::TaskManager.Task::(_decref) Task=`2ddc4eb2-0f10-459e-be3f-edaef96d294f`::ref 0 aborting False >Thread-519::DEBUG::2012-11-29 15:09:51,054::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-519::DEBUG::2012-11-29 15:09:51,055::task::568::TaskManager.Task::(_updateState) Task=`3d6317a1-ec4c-402c-b4eb-d46c4a9b2d99`::moving from state init -> state preparing >Thread-519::INFO::2012-11-29 15:09:51,055::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-519::DEBUG::2012-11-29 15:09:51,055::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`298705c2-6c79-45a8-bd1c-1c4f73210eba`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-519::DEBUG::2012-11-29 15:09:51,055::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-519::DEBUG::2012-11-29 15:09:51,056::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-519::DEBUG::2012-11-29 15:09:51,056::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`298705c2-6c79-45a8-bd1c-1c4f73210eba`::Granted request >Thread-519::DEBUG::2012-11-29 15:09:51,056::task::794::TaskManager.Task::(resourceAcquired) Task=`3d6317a1-ec4c-402c-b4eb-d46c4a9b2d99`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-519::DEBUG::2012-11-29 15:09:51,056::task::957::TaskManager.Task::(_decref) Task=`3d6317a1-ec4c-402c-b4eb-d46c4a9b2d99`::ref 1 aborting False >Thread-519::DEBUG::2012-11-29 15:09:51,057::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`e6a84fbd-5f39-4f4a-8952-0bced9251804`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-519::DEBUG::2012-11-29 15:09:51,057::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'exclusive' >Thread-519::DEBUG::2012-11-29 15:09:51,057::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'exclusive' (1 active user) >Thread-519::DEBUG::2012-11-29 15:09:51,057::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`e6a84fbd-5f39-4f4a-8952-0bced9251804`::Granted request >Thread-519::DEBUG::2012-11-29 15:09:51,058::task::794::TaskManager.Task::(resourceAcquired) Task=`3d6317a1-ec4c-402c-b4eb-d46c4a9b2d99`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (exclusive) >Thread-519::DEBUG::2012-11-29 15:09:51,058::task::957::TaskManager.Task::(_decref) Task=`3d6317a1-ec4c-402c-b4eb-d46c4a9b2d99`::ref 1 aborting False >Thread-519::INFO::2012-11-29 15:09:51,058::sp::1045::Storage.StoragePool::(activateSD) sdUUID=8b0589fb-75aa-4da8-bd44-c57742910be4 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-519::DEBUG::2012-11-29 15:09:51,059::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-519::DEBUG::2012-11-29 15:09:51,059::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-519::DEBUG::2012-11-29 15:09:51,059::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=aa28f4f51131190d7cc3b8fb3004d87ed6748441'] >Thread-519::DEBUG::2012-11-29 15:09:51,063::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-519::INFO::2012-11-29 15:09:51,063::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-519::DEBUG::2012-11-29 15:09:51,064::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-519::DEBUG::2012-11-29 15:09:51,064::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-519::DEBUG::2012-11-29 15:09:51,064::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-519::DEBUG::2012-11-29 15:09:51,064::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-519::DEBUG::2012-11-29 15:09:51,064::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-519::DEBUG::2012-11-29 15:09:51,065::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-519::DEBUG::2012-11-29 15:09:51,065::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` started monitoring domain `8b0589fb-75aa-4da8-bd44-c57742910be4` >Thread-520::DEBUG::2012-11-29 15:09:51,065::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-519::DEBUG::2012-11-29 15:09:51,066::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-519::INFO::2012-11-29 15:09:51,067::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-519::DEBUG::2012-11-29 15:09:51,068::task::1151::TaskManager.Task::(prepare) Task=`3d6317a1-ec4c-402c-b4eb-d46c4a9b2d99`::finished: None >Thread-519::DEBUG::2012-11-29 15:09:51,069::task::568::TaskManager.Task::(_updateState) Task=`3d6317a1-ec4c-402c-b4eb-d46c4a9b2d99`::moving from state preparing -> state finished >Thread-519::DEBUG::2012-11-29 15:09:51,070::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-519::DEBUG::2012-11-29 15:09:51,072::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-519::DEBUG::2012-11-29 15:09:51,074::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-519::DEBUG::2012-11-29 15:09:51,075::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-519::DEBUG::2012-11-29 15:09:51,077::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-519::DEBUG::2012-11-29 15:09:51,078::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-519::DEBUG::2012-11-29 15:09:51,080::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-519::DEBUG::2012-11-29 15:09:51,081::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-519::DEBUG::2012-11-29 15:09:51,082::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-519::DEBUG::2012-11-29 15:09:51,082::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-519::DEBUG::2012-11-29 15:09:51,083::task::957::TaskManager.Task::(_decref) Task=`3d6317a1-ec4c-402c-b4eb-d46c4a9b2d99`::ref 0 aborting False >Thread-521::DEBUG::2012-11-29 15:09:51,136::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-521::DEBUG::2012-11-29 15:09:51,137::task::568::TaskManager.Task::(_updateState) Task=`7d7b71ad-93be-491c-b81f-1feef236bc83`::moving from state init -> state preparing >Thread-521::INFO::2012-11-29 15:09:51,137::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-521::DEBUG::2012-11-29 15:09:51,137::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`a2bebc47-91f1-45f3-9ae4-996178e21b0d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-521::DEBUG::2012-11-29 15:09:51,138::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-521::DEBUG::2012-11-29 15:09:51,138::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-521::DEBUG::2012-11-29 15:09:51,138::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`a2bebc47-91f1-45f3-9ae4-996178e21b0d`::Granted request >Thread-521::DEBUG::2012-11-29 15:09:51,138::task::794::TaskManager.Task::(resourceAcquired) Task=`7d7b71ad-93be-491c-b81f-1feef236bc83`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-521::DEBUG::2012-11-29 15:09:51,139::task::957::TaskManager.Task::(_decref) Task=`7d7b71ad-93be-491c-b81f-1feef236bc83`::ref 1 aborting False >Thread-521::INFO::2012-11-29 15:09:51,139::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-521::DEBUG::2012-11-29 15:09:51,142::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=aa28f4f51131190d7cc3b8fb3004d87ed6748441'] >Thread-521::DEBUG::2012-11-29 15:09:51,143::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:51,143::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:51,143::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:51,143::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:51,144::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:51,144::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:51,144::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-521::DEBUG::2012-11-29 15:09:51,144::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-521::DEBUG::2012-11-29 15:09:51,144::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-521::DEBUG::2012-11-29 15:09:51,145::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-521::DEBUG::2012-11-29 15:09:51,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-521::DEBUG::2012-11-29 15:09:51,159::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-521::DEBUG::2012-11-29 15:09:51,159::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-521::DEBUG::2012-11-29 15:09:51,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-521::DEBUG::2012-11-29 15:09:51,163::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-521::DEBUG::2012-11-29 15:09:51,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-521::DEBUG::2012-11-29 15:09:51,167::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-521::DEBUG::2012-11-29 15:09:51,169::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-521::DEBUG::2012-11-29 15:09:51,172::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-521::DEBUG::2012-11-29 15:09:51,174::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-521::DEBUG::2012-11-29 15:09:51,175::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-521::DEBUG::2012-11-29 15:09:53,179::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-521::DEBUG::2012-11-29 15:09:53,237::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-521::DEBUG::2012-11-29 15:09:53,237::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,238::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,238::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,238::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,239::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,239::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,239::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-521::DEBUG::2012-11-29 15:09:53,240::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,241::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-521::DEBUG::2012-11-29 15:09:53,398::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-521::WARNING::2012-11-29 15:09:53,399::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-521::DEBUG::2012-11-29 15:09:53,399::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,406::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-521::DEBUG::2012-11-29 15:09:53,406::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-521::DEBUG::2012-11-29 15:09:53,409::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=aa28f4f51131190d7cc3b8fb3004d87ed6748441'] >Thread-521::DEBUG::2012-11-29 15:09:53,419::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-521::WARNING::2012-11-29 15:09:53,419::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-521::WARNING::2012-11-29 15:09:53,420::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-521::DEBUG::2012-11-29 15:09:53,420::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-521::DEBUG::2012-11-29 15:09:53,420::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-521::DEBUG::2012-11-29 15:09:53,420::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-521::DEBUG::2012-11-29 15:09:53,421::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-521::WARNING::2012-11-29 15:09:53,421::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-521::DEBUG::2012-11-29 15:09:53,421::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-521::DEBUG::2012-11-29 15:09:53,422::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8b0589fb-75aa-4da8-bd44-c57742910be4' (cwd None) >Thread-521::DEBUG::2012-11-29 15:09:53,573::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found\n'; <rc> = 5 >Thread-521::WARNING::2012-11-29 15:09:53,574::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found'] >Thread-521::DEBUG::2012-11-29 15:09:53,574::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-521::INFO::2012-11-29 15:09:53,579::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-521::INFO::2012-11-29 15:09:53,579::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-521::INFO::2012-11-29 15:09:53,580::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-521::INFO::2012-11-29 15:09:53,580::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-521::DEBUG::2012-11-29 15:09:53,580::task::1151::TaskManager.Task::(prepare) Task=`7d7b71ad-93be-491c-b81f-1feef236bc83`::finished: None >Thread-521::DEBUG::2012-11-29 15:09:53,580::task::568::TaskManager.Task::(_updateState) Task=`7d7b71ad-93be-491c-b81f-1feef236bc83`::moving from state preparing -> state finished >Thread-521::DEBUG::2012-11-29 15:09:53,581::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-521::DEBUG::2012-11-29 15:09:53,581::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-521::DEBUG::2012-11-29 15:09:53,581::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-521::DEBUG::2012-11-29 15:09:53,581::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-521::DEBUG::2012-11-29 15:09:53,582::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-521::DEBUG::2012-11-29 15:09:53,582::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-521::DEBUG::2012-11-29 15:09:53,582::task::957::TaskManager.Task::(_decref) Task=`7d7b71ad-93be-491c-b81f-1feef236bc83`::ref 0 aborting False >Thread-527::DEBUG::2012-11-29 15:09:53,619::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-527::DEBUG::2012-11-29 15:09:53,621::task::568::TaskManager.Task::(_updateState) Task=`84553c0b-be37-4316-9b9c-e7e3f7fd6613`::moving from state init -> state preparing >Thread-527::INFO::2012-11-29 15:09:53,624::logUtils::37::dispatcher::(wrapper) Run and protect: getIsoList(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', extension='iso', options=None) >Thread-527::DEBUG::2012-11-29 15:09:53,629::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`18499c2f-ef4a-45fd-9aad-5e572afc92d3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-527::DEBUG::2012-11-29 15:09:53,631::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-527::DEBUG::2012-11-29 15:09:53,634::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-527::DEBUG::2012-11-29 15:09:53,635::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`18499c2f-ef4a-45fd-9aad-5e572afc92d3`::Granted request >Thread-527::DEBUG::2012-11-29 15:09:53,637::task::794::TaskManager.Task::(resourceAcquired) Task=`84553c0b-be37-4316-9b9c-e7e3f7fd6613`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-527::DEBUG::2012-11-29 15:09:53,637::task::957::TaskManager.Task::(_decref) Task=`84553c0b-be37-4316-9b9c-e7e3f7fd6613`::ref 1 aborting False >Thread-527::DEBUG::2012-11-29 15:09:53,638::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-527::DEBUG::2012-11-29 15:09:53,642::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8b0589fb-75aa-4da8-bd44-c57742910be4' (cwd None) >Thread-527::DEBUG::2012-11-29 15:09:53,793::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found\n'; <rc> = 5 >Thread-527::WARNING::2012-11-29 15:09:53,793::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found'] >Thread-527::DEBUG::2012-11-29 15:09:53,794::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-527::DEBUG::2012-11-29 15:09:53,800::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-527::DEBUG::2012-11-29 15:09:53,800::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-527::DEBUG::2012-11-29 15:09:53,803::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=fcbd35a59c29b923dccdd6639a0a0b82265883b2'] >Thread-527::DEBUG::2012-11-29 15:09:53,804::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-527::WARNING::2012-11-29 15:09:53,805::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 8b0589fb-75aa-4da8-bd44-c57742910be4_imageNS already registered >Thread-527::WARNING::2012-11-29 15:09:53,805::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 8b0589fb-75aa-4da8-bd44-c57742910be4_volumeNS already registered >Thread-527::INFO::2012-11-29 15:09:53,806::logUtils::39::dispatcher::(wrapper) Run and protect: getIsoList, Return response: {'isolist': []} >Thread-527::DEBUG::2012-11-29 15:09:53,807::task::1151::TaskManager.Task::(prepare) Task=`84553c0b-be37-4316-9b9c-e7e3f7fd6613`::finished: {'isolist': []} >Thread-527::DEBUG::2012-11-29 15:09:53,807::task::568::TaskManager.Task::(_updateState) Task=`84553c0b-be37-4316-9b9c-e7e3f7fd6613`::moving from state preparing -> state finished >Thread-527::DEBUG::2012-11-29 15:09:53,807::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-527::DEBUG::2012-11-29 15:09:53,807::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-527::DEBUG::2012-11-29 15:09:53,807::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-527::DEBUG::2012-11-29 15:09:53,808::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-527::DEBUG::2012-11-29 15:09:53,808::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-527::DEBUG::2012-11-29 15:09:53,808::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-527::DEBUG::2012-11-29 15:09:53,808::task::957::TaskManager.Task::(_decref) Task=`84553c0b-be37-4316-9b9c-e7e3f7fd6613`::ref 0 aborting False >Thread-530::DEBUG::2012-11-29 15:09:53,851::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-530::DEBUG::2012-11-29 15:09:53,851::task::568::TaskManager.Task::(_updateState) Task=`a2f1fdcd-827b-4113-ba70-aa5238a52818`::moving from state init -> state preparing >Thread-530::INFO::2012-11-29 15:09:53,852::logUtils::37::dispatcher::(wrapper) Run and protect: getFloppyList(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-530::INFO::2012-11-29 15:09:53,852::logUtils::37::dispatcher::(wrapper) Run and protect: getIsoList(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', extension='vfd', options=None) >Thread-530::DEBUG::2012-11-29 15:09:53,852::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`538fec7e-64eb-4825-b523-d36538a679b4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-530::DEBUG::2012-11-29 15:09:53,852::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-530::DEBUG::2012-11-29 15:09:53,853::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-530::DEBUG::2012-11-29 15:09:53,853::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`538fec7e-64eb-4825-b523-d36538a679b4`::Granted request >Thread-530::DEBUG::2012-11-29 15:09:53,853::task::794::TaskManager.Task::(resourceAcquired) Task=`a2f1fdcd-827b-4113-ba70-aa5238a52818`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-530::DEBUG::2012-11-29 15:09:53,853::task::957::TaskManager.Task::(_decref) Task=`a2f1fdcd-827b-4113-ba70-aa5238a52818`::ref 1 aborting False >Thread-530::INFO::2012-11-29 15:09:53,855::logUtils::39::dispatcher::(wrapper) Run and protect: getIsoList, Return response: {'isolist': []} >Thread-530::INFO::2012-11-29 15:09:53,855::logUtils::39::dispatcher::(wrapper) Run and protect: getFloppyList, Return response: {'isolist': []} >Thread-530::DEBUG::2012-11-29 15:09:53,855::task::1151::TaskManager.Task::(prepare) Task=`a2f1fdcd-827b-4113-ba70-aa5238a52818`::finished: {'isolist': []} >Thread-530::DEBUG::2012-11-29 15:09:53,855::task::568::TaskManager.Task::(_updateState) Task=`a2f1fdcd-827b-4113-ba70-aa5238a52818`::moving from state preparing -> state finished >Thread-530::DEBUG::2012-11-29 15:09:53,855::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-530::DEBUG::2012-11-29 15:09:53,856::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-530::DEBUG::2012-11-29 15:09:53,856::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-530::DEBUG::2012-11-29 15:09:53,856::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-530::DEBUG::2012-11-29 15:09:53,856::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-530::DEBUG::2012-11-29 15:09:53,856::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-530::DEBUG::2012-11-29 15:09:53,857::task::957::TaskManager.Task::(_decref) Task=`a2f1fdcd-827b-4113-ba70-aa5238a52818`::ref 0 aborting False >Thread-531::DEBUG::2012-11-29 15:09:54,440::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-531::DEBUG::2012-11-29 15:09:54,441::task::568::TaskManager.Task::(_updateState) Task=`d7e1dfcc-b851-4ca0-ae19-f13bc24ca131`::moving from state init -> state preparing >Thread-531::INFO::2012-11-29 15:09:54,441::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-531::INFO::2012-11-29 15:09:54,442::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-531::DEBUG::2012-11-29 15:09:54,442::task::1151::TaskManager.Task::(prepare) Task=`d7e1dfcc-b851-4ca0-ae19-f13bc24ca131`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-531::DEBUG::2012-11-29 15:09:54,442::task::568::TaskManager.Task::(_updateState) Task=`d7e1dfcc-b851-4ca0-ae19-f13bc24ca131`::moving from state preparing -> state finished >Thread-531::DEBUG::2012-11-29 15:09:54,442::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-531::DEBUG::2012-11-29 15:09:54,443::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-531::DEBUG::2012-11-29 15:09:54,443::task::957::TaskManager.Task::(_decref) Task=`d7e1dfcc-b851-4ca0-ae19-f13bc24ca131`::ref 0 aborting False >Thread-532::DEBUG::2012-11-29 15:09:54,473::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-532::DEBUG::2012-11-29 15:09:54,473::task::568::TaskManager.Task::(_updateState) Task=`7a21471b-fc58-4332-bd27-ffc846a1b719`::moving from state init -> state preparing >Thread-532::INFO::2012-11-29 15:09:54,473::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-532::DEBUG::2012-11-29 15:09:54,473::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`34f5dbef-e0a3-4954-917c-05d46ba1ec91`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-532::DEBUG::2012-11-29 15:09:54,474::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-532::DEBUG::2012-11-29 15:09:54,474::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-532::DEBUG::2012-11-29 15:09:54,474::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`34f5dbef-e0a3-4954-917c-05d46ba1ec91`::Granted request >Thread-532::DEBUG::2012-11-29 15:09:54,474::task::794::TaskManager.Task::(resourceAcquired) Task=`7a21471b-fc58-4332-bd27-ffc846a1b719`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-532::DEBUG::2012-11-29 15:09:54,474::task::957::TaskManager.Task::(_decref) Task=`7a21471b-fc58-4332-bd27-ffc846a1b719`::ref 1 aborting False >Thread-532::INFO::2012-11-29 15:09:54,477::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/8b0589fb-75aa-4da8-bd44-c57742910be4/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861056008192', 'alerts': [], 'disktotal': '861058105344'}, '8b0589fb-75aa-4da8-bd44-c57742910be4': {'status': 'Active', 'diskfree': '861056008192', 'alerts': [], 'disktotal': '861056008192'}}} >Thread-532::DEBUG::2012-11-29 15:09:54,477::task::1151::TaskManager.Task::(prepare) Task=`7a21471b-fc58-4332-bd27-ffc846a1b719`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Active', 'pool_status': 'connected', 'isoprefix': '/rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/8b0589fb-75aa-4da8-bd44-c57742910be4/images/11111111-1111-1111-1111-111111111111', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861056008192', 'alerts': [], 'disktotal': '861058105344'}, '8b0589fb-75aa-4da8-bd44-c57742910be4': {'status': 'Active', 'diskfree': '861056008192', 'alerts': [], 'disktotal': '861056008192'}}} >Thread-532::DEBUG::2012-11-29 15:09:54,477::task::568::TaskManager.Task::(_updateState) Task=`7a21471b-fc58-4332-bd27-ffc846a1b719`::moving from state preparing -> state finished >Thread-532::DEBUG::2012-11-29 15:09:54,477::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-532::DEBUG::2012-11-29 15:09:54,477::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-532::DEBUG::2012-11-29 15:09:54,478::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-532::DEBUG::2012-11-29 15:09:54,478::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-532::DEBUG::2012-11-29 15:09:54,478::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-532::DEBUG::2012-11-29 15:09:54,478::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-532::DEBUG::2012-11-29 15:09:54,478::task::957::TaskManager.Task::(_decref) Task=`7a21471b-fc58-4332-bd27-ffc846a1b719`::ref 0 aborting False >Thread-533::DEBUG::2012-11-29 15:09:54,690::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-533::DEBUG::2012-11-29 15:09:54,691::task::568::TaskManager.Task::(_updateState) Task=`e5d43eda-40b3-46c1-baf1-4db901f15265`::moving from state init -> state preparing >Thread-533::INFO::2012-11-29 15:09:54,691::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-533::DEBUG::2012-11-29 15:09:54,691::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c02347e6-986c-4792-b81e-b87c3188830c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-533::DEBUG::2012-11-29 15:09:54,692::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-533::DEBUG::2012-11-29 15:09:54,692::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-533::DEBUG::2012-11-29 15:09:54,692::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c02347e6-986c-4792-b81e-b87c3188830c`::Granted request >Thread-533::DEBUG::2012-11-29 15:09:54,692::task::794::TaskManager.Task::(resourceAcquired) Task=`e5d43eda-40b3-46c1-baf1-4db901f15265`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-533::DEBUG::2012-11-29 15:09:54,692::task::957::TaskManager.Task::(_decref) Task=`e5d43eda-40b3-46c1-baf1-4db901f15265`::ref 1 aborting False >Thread-533::DEBUG::2012-11-29 15:09:54,693::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`18ad5079-f3a6-4251-b1f3-1a8df5816bd0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-533::DEBUG::2012-11-29 15:09:54,693::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'exclusive' >Thread-533::DEBUG::2012-11-29 15:09:54,693::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'exclusive' (1 active user) >Thread-533::DEBUG::2012-11-29 15:09:54,693::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`18ad5079-f3a6-4251-b1f3-1a8df5816bd0`::Granted request >Thread-533::DEBUG::2012-11-29 15:09:54,694::task::794::TaskManager.Task::(resourceAcquired) Task=`e5d43eda-40b3-46c1-baf1-4db901f15265`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (exclusive) >Thread-533::DEBUG::2012-11-29 15:09:54,694::task::957::TaskManager.Task::(_decref) Task=`e5d43eda-40b3-46c1-baf1-4db901f15265`::ref 1 aborting False >Thread-533::INFO::2012-11-29 15:09:54,694::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=8b0589fb-75aa-4da8-bd44-c57742910be4 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-533::DEBUG::2012-11-29 15:09:54,696::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-533::DEBUG::2012-11-29 15:09:54,696::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-533::DEBUG::2012-11-29 15:09:54,696::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9af281c297533c54610537f921129be9e3a04c95'] >Thread-533::DEBUG::2012-11-29 15:09:54,699::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-533::DEBUG::2012-11-29 15:09:54,700::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-533::DEBUG::2012-11-29 15:09:54,700::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-520::DEBUG::2012-11-29 15:09:54,700::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-533::DEBUG::2012-11-29 15:09:54,700::sp::1558::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` stopped monitoring domain `8b0589fb-75aa-4da8-bd44-c57742910be4` >Thread-533::DEBUG::2012-11-29 15:09:54,700::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-533::INFO::2012-11-29 15:09:54,701::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-533::DEBUG::2012-11-29 15:09:54,701::task::1151::TaskManager.Task::(prepare) Task=`e5d43eda-40b3-46c1-baf1-4db901f15265`::finished: None >Thread-533::DEBUG::2012-11-29 15:09:54,701::task::568::TaskManager.Task::(_updateState) Task=`e5d43eda-40b3-46c1-baf1-4db901f15265`::moving from state preparing -> state finished >Thread-533::DEBUG::2012-11-29 15:09:54,701::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-533::DEBUG::2012-11-29 15:09:54,701::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-533::DEBUG::2012-11-29 15:09:54,702::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-533::DEBUG::2012-11-29 15:09:54,702::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-533::DEBUG::2012-11-29 15:09:54,702::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-533::DEBUG::2012-11-29 15:09:54,702::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-533::DEBUG::2012-11-29 15:09:54,702::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-533::DEBUG::2012-11-29 15:09:54,702::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-533::DEBUG::2012-11-29 15:09:54,703::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-533::DEBUG::2012-11-29 15:09:54,703::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-533::DEBUG::2012-11-29 15:09:54,703::task::957::TaskManager.Task::(_decref) Task=`e5d43eda-40b3-46c1-baf1-4db901f15265`::ref 0 aborting False >Thread-534::DEBUG::2012-11-29 15:09:54,757::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-534::DEBUG::2012-11-29 15:09:54,758::task::568::TaskManager.Task::(_updateState) Task=`fe9c2828-bbc4-4d40-86be-30cac625d248`::moving from state init -> state preparing >Thread-534::INFO::2012-11-29 15:09:54,758::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-534::DEBUG::2012-11-29 15:09:54,758::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`1dedb4a4-6265-461d-a135-1329a82c2498`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-534::DEBUG::2012-11-29 15:09:54,759::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-534::DEBUG::2012-11-29 15:09:54,759::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-534::DEBUG::2012-11-29 15:09:54,759::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`1dedb4a4-6265-461d-a135-1329a82c2498`::Granted request >Thread-534::DEBUG::2012-11-29 15:09:54,759::task::794::TaskManager.Task::(resourceAcquired) Task=`fe9c2828-bbc4-4d40-86be-30cac625d248`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-534::DEBUG::2012-11-29 15:09:54,759::task::957::TaskManager.Task::(_decref) Task=`fe9c2828-bbc4-4d40-86be-30cac625d248`::ref 1 aborting False >Thread-534::INFO::2012-11-29 15:09:54,760::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-534::DEBUG::2012-11-29 15:09:54,763::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9af281c297533c54610537f921129be9e3a04c95'] >Thread-534::DEBUG::2012-11-29 15:09:54,763::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,763::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,763::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,764::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,764::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,764::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,764::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,765::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-534::DEBUG::2012-11-29 15:09:54,916::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-534::WARNING::2012-11-29 15:09:54,917::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-534::DEBUG::2012-11-29 15:09:54,917::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,922::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-534::DEBUG::2012-11-29 15:09:54,922::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-534::DEBUG::2012-11-29 15:09:54,925::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,8b0589fb-75aa-4da8-bd44-c57742910be4:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9af281c297533c54610537f921129be9e3a04c95'] >Thread-534::DEBUG::2012-11-29 15:09:54,926::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-534::WARNING::2012-11-29 15:09:54,926::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-534::WARNING::2012-11-29 15:09:54,927::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-534::DEBUG::2012-11-29 15:09:54,927::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-534::DEBUG::2012-11-29 15:09:54,927::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-534::DEBUG::2012-11-29 15:09:54,927::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-534::DEBUG::2012-11-29 15:09:54,928::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-534::WARNING::2012-11-29 15:09:54,928::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-534::DEBUG::2012-11-29 15:09:54,928::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-534::DEBUG::2012-11-29 15:09:54,929::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-537::DEBUG::2012-11-29 15:09:55,004::task::568::TaskManager.Task::(_updateState) Task=`2b92ebc1-3957-4ac1-bb21-9e6536237d16`::moving from state init -> state preparing >Thread-537::INFO::2012-11-29 15:09:55,004::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-537::INFO::2012-11-29 15:09:55,004::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00482678413391', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-537::DEBUG::2012-11-29 15:09:55,005::task::1151::TaskManager.Task::(prepare) Task=`2b92ebc1-3957-4ac1-bb21-9e6536237d16`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00482678413391', 'lastCheck': '1.4', 'code': 0, 'valid': True}} >Thread-537::DEBUG::2012-11-29 15:09:55,005::task::568::TaskManager.Task::(_updateState) Task=`2b92ebc1-3957-4ac1-bb21-9e6536237d16`::moving from state preparing -> state finished >Thread-537::DEBUG::2012-11-29 15:09:55,005::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-537::DEBUG::2012-11-29 15:09:55,005::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-537::DEBUG::2012-11-29 15:09:55,005::task::957::TaskManager.Task::(_decref) Task=`2b92ebc1-3957-4ac1-bb21-9e6536237d16`::ref 0 aborting False >Thread-534::DEBUG::2012-11-29 15:09:55,072::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-534::DEBUG::2012-11-29 15:09:55,072::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-534::INFO::2012-11-29 15:09:55,076::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-534::INFO::2012-11-29 15:09:55,077::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-534::INFO::2012-11-29 15:09:55,077::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-534::DEBUG::2012-11-29 15:09:55,077::task::1151::TaskManager.Task::(prepare) Task=`fe9c2828-bbc4-4d40-86be-30cac625d248`::finished: None >Thread-534::DEBUG::2012-11-29 15:09:55,077::task::568::TaskManager.Task::(_updateState) Task=`fe9c2828-bbc4-4d40-86be-30cac625d248`::moving from state preparing -> state finished >Thread-534::DEBUG::2012-11-29 15:09:55,078::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-534::DEBUG::2012-11-29 15:09:55,078::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-534::DEBUG::2012-11-29 15:09:55,078::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-534::DEBUG::2012-11-29 15:09:55,078::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-534::DEBUG::2012-11-29 15:09:55,079::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-534::DEBUG::2012-11-29 15:09:55,079::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-534::DEBUG::2012-11-29 15:09:55,079::task::957::TaskManager.Task::(_decref) Task=`fe9c2828-bbc4-4d40-86be-30cac625d248`::ref 0 aborting False >Thread-541::DEBUG::2012-11-29 15:09:55,110::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-541::DEBUG::2012-11-29 15:09:55,110::task::568::TaskManager.Task::(_updateState) Task=`33aac7ec-febe-4f47-8264-4abc63afd7c2`::moving from state init -> state preparing >Thread-541::INFO::2012-11-29 15:09:55,110::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '751c3b23-d629-4309-b2a9-4435f5f82959', 'port': ''}], options=None) >Thread-541::DEBUG::2012-11-29 15:09:55,111::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301' (cwd None) >Thread-541::DEBUG::2012-11-29 15:09:55,136::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-541::DEBUG::2012-11-29 15:09:55,136::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-541::DEBUG::2012-11-29 15:09:55,136::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-541::DEBUG::2012-11-29 15:09:55,137::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-541::DEBUG::2012-11-29 15:09:55,137::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-541::DEBUG::2012-11-29 15:09:55,150::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-541::DEBUG::2012-11-29 15:09:55,150::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-541::DEBUG::2012-11-29 15:09:55,152::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-541::DEBUG::2012-11-29 15:09:55,155::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-541::DEBUG::2012-11-29 15:09:55,157::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-541::DEBUG::2012-11-29 15:09:55,159::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-541::DEBUG::2012-11-29 15:09:55,161::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-541::DEBUG::2012-11-29 15:09:55,163::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-541::DEBUG::2012-11-29 15:09:55,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-541::DEBUG::2012-11-29 15:09:55,167::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-541::DEBUG::2012-11-29 15:09:57,170::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-541::DEBUG::2012-11-29 15:09:57,231::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-541::DEBUG::2012-11-29 15:09:57,232::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-541::DEBUG::2012-11-29 15:09:57,232::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-541::DEBUG::2012-11-29 15:09:57,232::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-541::DEBUG::2012-11-29 15:09:57,233::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-541::DEBUG::2012-11-29 15:09:57,233::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-541::DEBUG::2012-11-29 15:09:57,233::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-541::DEBUG::2012-11-29 15:09:57,233::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-541::INFO::2012-11-29 15:09:57,234::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-541::DEBUG::2012-11-29 15:09:57,234::task::1151::TaskManager.Task::(prepare) Task=`33aac7ec-febe-4f47-8264-4abc63afd7c2`::finished: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-541::DEBUG::2012-11-29 15:09:57,234::task::568::TaskManager.Task::(_updateState) Task=`33aac7ec-febe-4f47-8264-4abc63afd7c2`::moving from state preparing -> state finished >Thread-541::DEBUG::2012-11-29 15:09:57,234::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-541::DEBUG::2012-11-29 15:09:57,234::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-541::DEBUG::2012-11-29 15:09:57,235::task::957::TaskManager.Task::(_decref) Task=`33aac7ec-febe-4f47-8264-4abc63afd7c2`::ref 0 aborting False >Thread-543::DEBUG::2012-11-29 15:09:58,942::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-543::DEBUG::2012-11-29 15:09:58,942::task::568::TaskManager.Task::(_updateState) Task=`fca4352c-cdf1-4943-89e8-96668a83488c`::moving from state init -> state preparing >Thread-543::INFO::2012-11-29 15:09:58,943::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '751c3b23-d629-4309-b2a9-4435f5f82959', 'port': ''}], options=None) >Thread-543::INFO::2012-11-29 15:09:58,943::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-543::DEBUG::2012-11-29 15:09:58,943::task::1151::TaskManager.Task::(prepare) Task=`fca4352c-cdf1-4943-89e8-96668a83488c`::finished: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-543::DEBUG::2012-11-29 15:09:58,943::task::568::TaskManager.Task::(_updateState) Task=`fca4352c-cdf1-4943-89e8-96668a83488c`::moving from state preparing -> state finished >Thread-543::DEBUG::2012-11-29 15:09:58,943::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-543::DEBUG::2012-11-29 15:09:58,943::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-543::DEBUG::2012-11-29 15:09:58,944::task::957::TaskManager.Task::(_decref) Task=`fca4352c-cdf1-4943-89e8-96668a83488c`::ref 0 aborting False >Thread-544::DEBUG::2012-11-29 15:09:58,972::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-544::DEBUG::2012-11-29 15:09:58,972::task::568::TaskManager.Task::(_updateState) Task=`2ef31389-3ce6-45db-bc72-359cf2308ab8`::moving from state init -> state preparing >Thread-544::INFO::2012-11-29 15:09:58,972::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '751c3b23-d629-4309-b2a9-4435f5f82959', 'port': ''}], options=None) >Thread-544::DEBUG::2012-11-29 15:09:58,974::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301' (cwd None) >Thread-544::INFO::2012-11-29 15:09:59,007::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-544::DEBUG::2012-11-29 15:09:59,007::task::1151::TaskManager.Task::(prepare) Task=`2ef31389-3ce6-45db-bc72-359cf2308ab8`::finished: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-544::DEBUG::2012-11-29 15:09:59,007::task::568::TaskManager.Task::(_updateState) Task=`2ef31389-3ce6-45db-bc72-359cf2308ab8`::moving from state preparing -> state finished >Thread-544::DEBUG::2012-11-29 15:09:59,007::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-544::DEBUG::2012-11-29 15:09:59,008::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-544::DEBUG::2012-11-29 15:09:59,008::task::957::TaskManager.Task::(_decref) Task=`2ef31389-3ce6-45db-bc72-359cf2308ab8`::ref 0 aborting False >Thread-545::DEBUG::2012-11-29 15:09:59,035::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-545::DEBUG::2012-11-29 15:09:59,036::task::568::TaskManager.Task::(_updateState) Task=`0d4a4f06-edfd-4c33-ab87-a7bc14f2da7d`::moving from state init -> state preparing >Thread-545::INFO::2012-11-29 15:09:59,036::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-545::DEBUG::2012-11-29 15:09:59,037::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`93a851db-43fd-41ae-a2b6-ae4280102c4c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-545::DEBUG::2012-11-29 15:09:59,037::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-545::DEBUG::2012-11-29 15:09:59,037::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-545::DEBUG::2012-11-29 15:09:59,037::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`93a851db-43fd-41ae-a2b6-ae4280102c4c`::Granted request >Thread-545::DEBUG::2012-11-29 15:09:59,038::task::794::TaskManager.Task::(resourceAcquired) Task=`0d4a4f06-edfd-4c33-ab87-a7bc14f2da7d`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-545::DEBUG::2012-11-29 15:09:59,038::task::957::TaskManager.Task::(_decref) Task=`0d4a4f06-edfd-4c33-ab87-a7bc14f2da7d`::ref 1 aborting False >Thread-545::DEBUG::2012-11-29 15:09:59,038::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`d161f16e-a7e3-421f-9c62-395518a40b32`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-545::DEBUG::2012-11-29 15:09:59,038::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'exclusive' >Thread-545::DEBUG::2012-11-29 15:09:59,039::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'exclusive' (1 active user) >Thread-545::DEBUG::2012-11-29 15:09:59,039::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`d161f16e-a7e3-421f-9c62-395518a40b32`::Granted request >Thread-545::DEBUG::2012-11-29 15:09:59,039::task::794::TaskManager.Task::(resourceAcquired) Task=`0d4a4f06-edfd-4c33-ab87-a7bc14f2da7d`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (exclusive) >Thread-545::DEBUG::2012-11-29 15:09:59,039::task::957::TaskManager.Task::(_decref) Task=`0d4a4f06-edfd-4c33-ab87-a7bc14f2da7d`::ref 1 aborting False >Thread-545::INFO::2012-11-29 15:09:59,040::sp::984::Storage.StoragePool::(detachSD) sdUUID=8b0589fb-75aa-4da8-bd44-c57742910be4 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-545::DEBUG::2012-11-29 15:09:59,040::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-545::DEBUG::2012-11-29 15:09:59,040::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-545::DEBUG::2012-11-29 15:09:59,040::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-545::DEBUG::2012-11-29 15:09:59,040::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-545::DEBUG::2012-11-29 15:09:59,041::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-545::DEBUG::2012-11-29 15:09:59,054::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-545::DEBUG::2012-11-29 15:09:59,055::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-545::DEBUG::2012-11-29 15:09:59,057::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-545::DEBUG::2012-11-29 15:09:59,059::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-545::DEBUG::2012-11-29 15:09:59,061::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-545::DEBUG::2012-11-29 15:09:59,063::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-545::DEBUG::2012-11-29 15:09:59,065::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-545::DEBUG::2012-11-29 15:09:59,067::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-545::DEBUG::2012-11-29 15:09:59,069::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-545::DEBUG::2012-11-29 15:09:59,071::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-545::DEBUG::2012-11-29 15:10:01,074::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-545::DEBUG::2012-11-29 15:10:01,126::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-545::DEBUG::2012-11-29 15:10:01,127::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-545::DEBUG::2012-11-29 15:10:01,127::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-545::DEBUG::2012-11-29 15:10:01,127::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-545::DEBUG::2012-11-29 15:10:01,128::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-545::DEBUG::2012-11-29 15:10:01,128::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-545::DEBUG::2012-11-29 15:10:01,128::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-545::DEBUG::2012-11-29 15:10:01,129::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-545::DEBUG::2012-11-29 15:10:01,129::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-545::DEBUG::2012-11-29 15:10:01,131::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8b0589fb-75aa-4da8-bd44-c57742910be4' (cwd None) >Thread-545::DEBUG::2012-11-29 15:10:01,298::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found\n'; <rc> = 5 >Thread-545::WARNING::2012-11-29 15:10:01,299::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found'] >Thread-545::DEBUG::2012-11-29 15:10:01,299::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-545::DEBUG::2012-11-29 15:10:01,304::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-545::DEBUG::2012-11-29 15:10:01,305::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-545::DEBUG::2012-11-29 15:10:01,307::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=fcbd35a59c29b923dccdd6639a0a0b82265883b2'] >Thread-545::DEBUG::2012-11-29 15:10:01,309::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-545::WARNING::2012-11-29 15:10:01,309::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 8b0589fb-75aa-4da8-bd44-c57742910be4_imageNS already registered >Thread-545::WARNING::2012-11-29 15:10:01,310::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 8b0589fb-75aa-4da8-bd44-c57742910be4_volumeNS already registered >Thread-545::DEBUG::2012-11-29 15:10:01,310::safelease::94::ClusterLock::(acquire) Acquiring cluster lock for domain 8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-545::DEBUG::2012-11-29 15:10:01,311::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c1 -n0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 8b0589fb-75aa-4da8-bd44-c57742910be4 1 5 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-545::DEBUG::2012-11-29 15:10:03,347::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-545::DEBUG::2012-11-29 15:10:03,347::safelease::109::ClusterLock::(acquire) Clustered lock acquired successfully >Thread-545::DEBUG::2012-11-29 15:10:03,354::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=fcbd35a59c29b923dccdd6639a0a0b82265883b2'] >Thread-545::DEBUG::2012-11-29 15:10:03,355::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-545::DEBUG::2012-11-29 15:10:03,355::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-545::DEBUG::2012-11-29 15:10:03,355::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-545::DEBUG::2012-11-29 15:10:03,355::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-545::DEBUG::2012-11-29 15:10:03,355::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=9f4dd59c4e9f8328dfa37a1d45ec7d9c67976419'] >Thread-545::DEBUG::2012-11-29 15:10:03,359::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-545::INFO::2012-11-29 15:10:03,359::safelease::119::ClusterLock::(release) Releasing cluster lock for domain 8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-545::DEBUG::2012-11-29 15:10:03,359::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 8b0589fb-75aa-4da8-bd44-c57742910be4' (cwd /usr/libexec/vdsm) >Thread-545::DEBUG::2012-11-29 15:10:04,428::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-545::DEBUG::2012-11-29 15:10:04,428::safelease::126::ClusterLock::(release) Cluster lock released successfully >Thread-545::WARNING::2012-11-29 15:10:04,428::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `8b0589fb-75aa-4da8-bd44-c57742910be4` >Thread-545::DEBUG::2012-11-29 15:10:04,429::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-545::DEBUG::2012-11-29 15:10:04,430::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-545::DEBUG::2012-11-29 15:10:04,430::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5d93bd966b3139ba2a97b71863479fd1506d2da7'] >Thread-545::DEBUG::2012-11-29 15:10:04,433::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-545::DEBUG::2012-11-29 15:10:04,434::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-545::DEBUG::2012-11-29 15:10:04,434::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-545::DEBUG::2012-11-29 15:10:04,434::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-545::DEBUG::2012-11-29 15:10:04,434::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `8b0589fb-75aa-4da8-bd44-c57742910be4` is done >Thread-545::INFO::2012-11-29 15:10:04,435::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-545::DEBUG::2012-11-29 15:10:04,435::task::1151::TaskManager.Task::(prepare) Task=`0d4a4f06-edfd-4c33-ab87-a7bc14f2da7d`::finished: None >Thread-545::DEBUG::2012-11-29 15:10:04,435::task::568::TaskManager.Task::(_updateState) Task=`0d4a4f06-edfd-4c33-ab87-a7bc14f2da7d`::moving from state preparing -> state finished >Thread-545::DEBUG::2012-11-29 15:10:04,435::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-545::DEBUG::2012-11-29 15:10:04,435::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-545::DEBUG::2012-11-29 15:10:04,436::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-545::DEBUG::2012-11-29 15:10:04,436::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-545::DEBUG::2012-11-29 15:10:04,436::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-545::DEBUG::2012-11-29 15:10:04,436::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-545::DEBUG::2012-11-29 15:10:04,437::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-545::DEBUG::2012-11-29 15:10:04,437::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-545::DEBUG::2012-11-29 15:10:04,437::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-545::DEBUG::2012-11-29 15:10:04,437::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-545::DEBUG::2012-11-29 15:10:04,437::task::957::TaskManager.Task::(_decref) Task=`0d4a4f06-edfd-4c33-ab87-a7bc14f2da7d`::ref 0 aborting False >Thread-551::DEBUG::2012-11-29 15:10:04,492::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-551::DEBUG::2012-11-29 15:10:04,492::task::568::TaskManager.Task::(_updateState) Task=`472c5ed8-9be7-4be5-854c-6d1b0037c7b1`::moving from state init -> state preparing >Thread-551::INFO::2012-11-29 15:10:04,493::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-551::DEBUG::2012-11-29 15:10:04,493::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`8ad33622-310b-46fc-a353-321430d716ce`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-551::DEBUG::2012-11-29 15:10:04,493::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-551::DEBUG::2012-11-29 15:10:04,493::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-551::DEBUG::2012-11-29 15:10:04,494::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`8ad33622-310b-46fc-a353-321430d716ce`::Granted request >Thread-551::DEBUG::2012-11-29 15:10:04,494::task::794::TaskManager.Task::(resourceAcquired) Task=`472c5ed8-9be7-4be5-854c-6d1b0037c7b1`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-551::DEBUG::2012-11-29 15:10:04,494::task::957::TaskManager.Task::(_decref) Task=`472c5ed8-9be7-4be5-854c-6d1b0037c7b1`::ref 1 aborting False >Thread-551::INFO::2012-11-29 15:10:04,494::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-551::DEBUG::2012-11-29 15:10:04,498::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5d93bd966b3139ba2a97b71863479fd1506d2da7'] >Thread-551::DEBUG::2012-11-29 15:10:04,498::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,498::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,499::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,499::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,499::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,499::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,500::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,501::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-552::DEBUG::2012-11-29 15:10:04,529::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-552::DEBUG::2012-11-29 15:10:04,529::task::568::TaskManager.Task::(_updateState) Task=`98e4dfdd-f50d-437d-9ed4-ee9b15d8f843`::moving from state init -> state preparing >Thread-552::INFO::2012-11-29 15:10:04,530::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-551::DEBUG::2012-11-29 15:10:04,664::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-551::WARNING::2012-11-29 15:10:04,665::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-551::DEBUG::2012-11-29 15:10:04,665::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,672::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-551::DEBUG::2012-11-29 15:10:04,672::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-551::DEBUG::2012-11-29 15:10:04,675::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5d93bd966b3139ba2a97b71863479fd1506d2da7'] >Thread-551::DEBUG::2012-11-29 15:10:04,676::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-551::WARNING::2012-11-29 15:10:04,676::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-551::WARNING::2012-11-29 15:10:04,676::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-552::INFO::2012-11-29 15:10:04,678::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-551::DEBUG::2012-11-29 15:10:04,678::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-552::DEBUG::2012-11-29 15:10:04,679::task::1151::TaskManager.Task::(prepare) Task=`98e4dfdd-f50d-437d-9ed4-ee9b15d8f843`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-551::DEBUG::2012-11-29 15:10:04,680::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-552::DEBUG::2012-11-29 15:10:04,681::task::568::TaskManager.Task::(_updateState) Task=`98e4dfdd-f50d-437d-9ed4-ee9b15d8f843`::moving from state preparing -> state finished >Thread-551::DEBUG::2012-11-29 15:10:04,681::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-552::DEBUG::2012-11-29 15:10:04,682::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-552::DEBUG::2012-11-29 15:10:04,684::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-551::DEBUG::2012-11-29 15:10:04,684::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-552::DEBUG::2012-11-29 15:10:04,685::task::957::TaskManager.Task::(_decref) Task=`98e4dfdd-f50d-437d-9ed4-ee9b15d8f843`::ref 0 aborting False >Thread-551::WARNING::2012-11-29 15:10:04,686::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-551::DEBUG::2012-11-29 15:10:04,690::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-551::DEBUG::2012-11-29 15:10:04,691::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-555::DEBUG::2012-11-29 15:10:04,717::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-555::DEBUG::2012-11-29 15:10:04,718::task::568::TaskManager.Task::(_updateState) Task=`7493db65-a36c-4f67-8c90-f5d8498b93e5`::moving from state init -> state preparing >Thread-555::INFO::2012-11-29 15:10:04,718::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-555::DEBUG::2012-11-29 15:10:04,718::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c9059d93-e5a1-4800-8110-364bb66ac17d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-555::DEBUG::2012-11-29 15:10:04,719::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-555::DEBUG::2012-11-29 15:10:04,719::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-555::DEBUG::2012-11-29 15:10:04,719::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c9059d93-e5a1-4800-8110-364bb66ac17d`::Granted request >Thread-555::DEBUG::2012-11-29 15:10:04,719::task::794::TaskManager.Task::(resourceAcquired) Task=`7493db65-a36c-4f67-8c90-f5d8498b93e5`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-555::DEBUG::2012-11-29 15:10:04,720::task::957::TaskManager.Task::(_decref) Task=`7493db65-a36c-4f67-8c90-f5d8498b93e5`::ref 1 aborting False >Thread-555::INFO::2012-11-29 15:10:04,723::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861056008192', 'alerts': [], 'disktotal': '861058105344'}}} >Thread-555::DEBUG::2012-11-29 15:10:04,723::task::1151::TaskManager.Task::(prepare) Task=`7493db65-a36c-4f67-8c90-f5d8498b93e5`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861056008192', 'alerts': [], 'disktotal': '861058105344'}}} >Thread-555::DEBUG::2012-11-29 15:10:04,723::task::568::TaskManager.Task::(_updateState) Task=`7493db65-a36c-4f67-8c90-f5d8498b93e5`::moving from state preparing -> state finished >Thread-555::DEBUG::2012-11-29 15:10:04,723::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-555::DEBUG::2012-11-29 15:10:04,723::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-555::DEBUG::2012-11-29 15:10:04,724::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-555::DEBUG::2012-11-29 15:10:04,724::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (1 active users) >Thread-555::DEBUG::2012-11-29 15:10:04,724::task::957::TaskManager.Task::(_decref) Task=`7493db65-a36c-4f67-8c90-f5d8498b93e5`::ref 0 aborting False >Thread-551::DEBUG::2012-11-29 15:10:04,834::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-551::DEBUG::2012-11-29 15:10:04,834::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-551::INFO::2012-11-29 15:10:04,838::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-551::INFO::2012-11-29 15:10:04,839::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-551::INFO::2012-11-29 15:10:04,839::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-551::DEBUG::2012-11-29 15:10:04,840::task::1151::TaskManager.Task::(prepare) Task=`472c5ed8-9be7-4be5-854c-6d1b0037c7b1`::finished: None >Thread-551::DEBUG::2012-11-29 15:10:04,840::task::568::TaskManager.Task::(_updateState) Task=`472c5ed8-9be7-4be5-854c-6d1b0037c7b1`::moving from state preparing -> state finished >Thread-551::DEBUG::2012-11-29 15:10:04,840::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-551::DEBUG::2012-11-29 15:10:04,840::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-551::DEBUG::2012-11-29 15:10:04,840::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-551::DEBUG::2012-11-29 15:10:04,841::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-551::DEBUG::2012-11-29 15:10:04,841::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-551::DEBUG::2012-11-29 15:10:04,841::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-551::DEBUG::2012-11-29 15:10:04,841::task::957::TaskManager.Task::(_decref) Task=`472c5ed8-9be7-4be5-854c-6d1b0037c7b1`::ref 0 aborting False >Thread-558::DEBUG::2012-11-29 15:10:04,873::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-558::DEBUG::2012-11-29 15:10:04,873::task::568::TaskManager.Task::(_updateState) Task=`222ecaac-0f17-422b-aa1d-17e3bb541ee5`::moving from state init -> state preparing >Thread-558::INFO::2012-11-29 15:10:04,873::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '751c3b23-d629-4309-b2a9-4435f5f82959', 'port': ''}], options=None) >Thread-558::DEBUG::2012-11-29 15:10:04,874::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301' (cwd None) >Thread-558::DEBUG::2012-11-29 15:10:04,910::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-558::DEBUG::2012-11-29 15:10:04,910::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-558::DEBUG::2012-11-29 15:10:04,910::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-558::DEBUG::2012-11-29 15:10:04,911::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-558::DEBUG::2012-11-29 15:10:04,911::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-558::DEBUG::2012-11-29 15:10:04,926::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-558::DEBUG::2012-11-29 15:10:04,926::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-558::DEBUG::2012-11-29 15:10:04,929::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-558::DEBUG::2012-11-29 15:10:04,931::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-558::DEBUG::2012-11-29 15:10:04,933::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-558::DEBUG::2012-11-29 15:10:04,935::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-558::DEBUG::2012-11-29 15:10:04,937::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-558::DEBUG::2012-11-29 15:10:04,939::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-558::DEBUG::2012-11-29 15:10:04,941::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-558::DEBUG::2012-11-29 15:10:04,943::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-559::DEBUG::2012-11-29 15:10:05,212::task::568::TaskManager.Task::(_updateState) Task=`894738b5-6084-4f3b-a0e9-06f2551f1340`::moving from state init -> state preparing >Thread-559::INFO::2012-11-29 15:10:05,212::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-559::INFO::2012-11-29 15:10:05,213::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00214409828186', 'lastCheck': '1.5', 'code': 0, 'valid': True}} >Thread-559::DEBUG::2012-11-29 15:10:05,213::task::1151::TaskManager.Task::(prepare) Task=`894738b5-6084-4f3b-a0e9-06f2551f1340`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00214409828186', 'lastCheck': '1.5', 'code': 0, 'valid': True}} >Thread-559::DEBUG::2012-11-29 15:10:05,213::task::568::TaskManager.Task::(_updateState) Task=`894738b5-6084-4f3b-a0e9-06f2551f1340`::moving from state preparing -> state finished >Thread-559::DEBUG::2012-11-29 15:10:05,213::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-559::DEBUG::2012-11-29 15:10:05,213::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-559::DEBUG::2012-11-29 15:10:05,214::task::957::TaskManager.Task::(_decref) Task=`894738b5-6084-4f3b-a0e9-06f2551f1340`::ref 0 aborting False >Thread-558::DEBUG::2012-11-29 15:10:06,946::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-558::DEBUG::2012-11-29 15:10:07,020::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-558::DEBUG::2012-11-29 15:10:07,021::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-558::DEBUG::2012-11-29 15:10:07,021::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-558::DEBUG::2012-11-29 15:10:07,021::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-558::DEBUG::2012-11-29 15:10:07,022::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-558::DEBUG::2012-11-29 15:10:07,022::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-558::DEBUG::2012-11-29 15:10:07,022::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-558::DEBUG::2012-11-29 15:10:07,022::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-558::INFO::2012-11-29 15:10:07,023::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-558::DEBUG::2012-11-29 15:10:07,023::task::1151::TaskManager.Task::(prepare) Task=`222ecaac-0f17-422b-aa1d-17e3bb541ee5`::finished: {'statuslist': [{'status': 0, 'id': '751c3b23-d629-4309-b2a9-4435f5f82959'}]} >Thread-558::DEBUG::2012-11-29 15:10:07,023::task::568::TaskManager.Task::(_updateState) Task=`222ecaac-0f17-422b-aa1d-17e3bb541ee5`::moving from state preparing -> state finished >Thread-558::DEBUG::2012-11-29 15:10:07,023::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-558::DEBUG::2012-11-29 15:10:07,023::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-558::DEBUG::2012-11-29 15:10:07,024::task::957::TaskManager.Task::(_decref) Task=`222ecaac-0f17-422b-aa1d-17e3bb541ee5`::ref 0 aborting False >Thread-562::DEBUG::2012-11-29 15:10:08,683::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-562::DEBUG::2012-11-29 15:10:08,684::task::568::TaskManager.Task::(_updateState) Task=`e80f0589-8fda-4987-a6f7-31b6746ae71c`::moving from state init -> state preparing >Thread-562::INFO::2012-11-29 15:10:08,684::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-562::INFO::2012-11-29 15:10:08,684::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-562::DEBUG::2012-11-29 15:10:08,684::task::1151::TaskManager.Task::(prepare) Task=`e80f0589-8fda-4987-a6f7-31b6746ae71c`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-562::DEBUG::2012-11-29 15:10:08,685::task::568::TaskManager.Task::(_updateState) Task=`e80f0589-8fda-4987-a6f7-31b6746ae71c`::moving from state preparing -> state finished >Thread-562::DEBUG::2012-11-29 15:10:08,685::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-562::DEBUG::2012-11-29 15:10:08,685::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-562::DEBUG::2012-11-29 15:10:08,685::task::957::TaskManager.Task::(_decref) Task=`e80f0589-8fda-4987-a6f7-31b6746ae71c`::ref 0 aborting False >Thread-563::DEBUG::2012-11-29 15:10:08,720::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-563::DEBUG::2012-11-29 15:10:08,720::task::568::TaskManager.Task::(_updateState) Task=`935b28de-12c2-4489-b1a0-0b8b9bd1fe5f`::moving from state init -> state preparing >Thread-563::INFO::2012-11-29 15:10:08,720::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3', 'port': ''}], options=None) >Thread-563::DEBUG::2012-11-29 15:10:08,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301' (cwd None) >Thread-563::INFO::2012-11-29 15:10:08,754::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-563::DEBUG::2012-11-29 15:10:08,754::task::1151::TaskManager.Task::(prepare) Task=`935b28de-12c2-4489-b1a0-0b8b9bd1fe5f`::finished: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-563::DEBUG::2012-11-29 15:10:08,755::task::568::TaskManager.Task::(_updateState) Task=`935b28de-12c2-4489-b1a0-0b8b9bd1fe5f`::moving from state preparing -> state finished >Thread-563::DEBUG::2012-11-29 15:10:08,755::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-563::DEBUG::2012-11-29 15:10:08,755::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-563::DEBUG::2012-11-29 15:10:08,755::task::957::TaskManager.Task::(_decref) Task=`935b28de-12c2-4489-b1a0-0b8b9bd1fe5f`::ref 0 aborting False >Thread-564::DEBUG::2012-11-29 15:10:08,789::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-564::DEBUG::2012-11-29 15:10:08,790::task::568::TaskManager.Task::(_updateState) Task=`81b7d34a-41e4-4205-a50e-8aaf78576c28`::moving from state init -> state preparing >Thread-564::INFO::2012-11-29 15:10:08,790::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=2, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', options=None) >Thread-564::DEBUG::2012-11-29 15:10:08,790::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-564::DEBUG::2012-11-29 15:10:08,790::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-564::DEBUG::2012-11-29 15:10:08,790::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-564::DEBUG::2012-11-29 15:10:08,791::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-564::DEBUG::2012-11-29 15:10:08,791::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-564::DEBUG::2012-11-29 15:10:08,805::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-564::DEBUG::2012-11-29 15:10:08,805::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-564::DEBUG::2012-11-29 15:10:08,807::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-564::DEBUG::2012-11-29 15:10:08,809::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-564::DEBUG::2012-11-29 15:10:08,811::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-564::DEBUG::2012-11-29 15:10:08,813::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-564::DEBUG::2012-11-29 15:10:08,815::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-564::DEBUG::2012-11-29 15:10:08,817::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-564::DEBUG::2012-11-29 15:10:08,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-564::DEBUG::2012-11-29 15:10:08,821::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-564::DEBUG::2012-11-29 15:10:10,824::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-564::DEBUG::2012-11-29 15:10:10,872::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-564::DEBUG::2012-11-29 15:10:10,872::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:10,872::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:10,873::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:10,873::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:10,873::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:10,874::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:10,874::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-564::DEBUG::2012-11-29 15:10:10,874::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:10,875::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-564::DEBUG::2012-11-29 15:10:11,025::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-564::DEBUG::2012-11-29 15:10:11,026::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:11,029::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:11,030::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8b0589fb-75aa-4da8-bd44-c57742910be4' (cwd None) >Thread-564::DEBUG::2012-11-29 15:10:11,181::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found\n'; <rc> = 5 >Thread-564::WARNING::2012-11-29 15:10:11,181::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found'] >Thread-564::DEBUG::2012-11-29 15:10:11,182::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-564::DEBUG::2012-11-29 15:10:11,188::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-564::DEBUG::2012-11-29 15:10:11,188::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-564::DEBUG::2012-11-29 15:10:11,191::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=9f4dd59c4e9f8328dfa37a1d45ec7d9c67976419'] >Thread-564::DEBUG::2012-11-29 15:10:11,193::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-564::WARNING::2012-11-29 15:10:11,193::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 8b0589fb-75aa-4da8-bd44-c57742910be4_imageNS already registered >Thread-564::WARNING::2012-11-29 15:10:11,194::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 8b0589fb-75aa-4da8-bd44-c57742910be4_volumeNS already registered >Thread-564::INFO::2012-11-29 15:10:11,194::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': ['8b0589fb-75aa-4da8-bd44-c57742910be4']} >Thread-564::DEBUG::2012-11-29 15:10:11,194::task::1151::TaskManager.Task::(prepare) Task=`81b7d34a-41e4-4205-a50e-8aaf78576c28`::finished: {'domlist': ['8b0589fb-75aa-4da8-bd44-c57742910be4']} >Thread-564::DEBUG::2012-11-29 15:10:11,195::task::568::TaskManager.Task::(_updateState) Task=`81b7d34a-41e4-4205-a50e-8aaf78576c28`::moving from state preparing -> state finished >Thread-564::DEBUG::2012-11-29 15:10:11,195::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-564::DEBUG::2012-11-29 15:10:11,195::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-564::DEBUG::2012-11-29 15:10:11,195::task::957::TaskManager.Task::(_decref) Task=`81b7d34a-41e4-4205-a50e-8aaf78576c28`::ref 0 aborting False >Thread-570::DEBUG::2012-11-29 15:10:11,300::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-570::DEBUG::2012-11-29 15:10:11,301::task::568::TaskManager.Task::(_updateState) Task=`60d7872d-b48a-4b27-ad20-b64e89260560`::moving from state init -> state preparing >Thread-570::INFO::2012-11-29 15:10:11,301::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', options=None) >Thread-570::INFO::2012-11-29 15:10:11,301::fileSD::302::Storage.StorageDomain::(validate) sdUUID=8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-570::DEBUG::2012-11-29 15:10:11,303::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=9f4dd59c4e9f8328dfa37a1d45ec7d9c67976419'] >Thread-570::DEBUG::2012-11-29 15:10:11,304::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`9f9a026b-40d4-4432-837b-7f3f4ebeee51`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-570::DEBUG::2012-11-29 15:10:11,304::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'shared' >Thread-570::DEBUG::2012-11-29 15:10:11,305::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'shared' (1 active user) >Thread-570::DEBUG::2012-11-29 15:10:11,305::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`9f9a026b-40d4-4432-837b-7f3f4ebeee51`::Granted request >Thread-570::DEBUG::2012-11-29 15:10:11,305::task::794::TaskManager.Task::(resourceAcquired) Task=`60d7872d-b48a-4b27-ad20-b64e89260560`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (shared) >Thread-570::DEBUG::2012-11-29 15:10:11,305::task::957::TaskManager.Task::(_decref) Task=`60d7872d-b48a-4b27-ad20-b64e89260560`::ref 1 aborting False >Thread-570::INFO::2012-11-29 15:10:11,308::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': '8b0589fb-75aa-4da8-bd44-c57742910be4', 'master_ver': 0, 'lver': -1, 'version': '0', 'role': 'Regular', 'remotePath': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'spm_id': -1, 'type': 'NFS', 'class': 'Iso', 'pool': [], 'name': 'ISODomainRest'}} >Thread-570::DEBUG::2012-11-29 15:10:11,308::task::1151::TaskManager.Task::(prepare) Task=`60d7872d-b48a-4b27-ad20-b64e89260560`::finished: {'info': {'uuid': '8b0589fb-75aa-4da8-bd44-c57742910be4', 'master_ver': 0, 'lver': -1, 'version': '0', 'role': 'Regular', 'remotePath': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'spm_id': -1, 'type': 'NFS', 'class': 'Iso', 'pool': [], 'name': 'ISODomainRest'}} >Thread-570::DEBUG::2012-11-29 15:10:11,308::task::568::TaskManager.Task::(_updateState) Task=`60d7872d-b48a-4b27-ad20-b64e89260560`::moving from state preparing -> state finished >Thread-570::DEBUG::2012-11-29 15:10:11,308::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-570::DEBUG::2012-11-29 15:10:11,308::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-570::DEBUG::2012-11-29 15:10:11,309::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-570::DEBUG::2012-11-29 15:10:11,309::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-570::DEBUG::2012-11-29 15:10:11,309::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-570::DEBUG::2012-11-29 15:10:11,309::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-570::DEBUG::2012-11-29 15:10:11,310::task::957::TaskManager.Task::(_decref) Task=`60d7872d-b48a-4b27-ad20-b64e89260560`::ref 0 aborting False >Thread-572::DEBUG::2012-11-29 15:10:11,365::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-572::DEBUG::2012-11-29 15:10:11,365::task::568::TaskManager.Task::(_updateState) Task=`5f15989f-e718-44b7-b898-3a6f34d95735`::moving from state init -> state preparing >Thread-572::INFO::2012-11-29 15:10:11,365::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=2, storageType=1, remotePath='', options=None) >Thread-572::DEBUG::2012-11-29 15:10:11,365::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-572::DEBUG::2012-11-29 15:10:11,365::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-572::DEBUG::2012-11-29 15:10:11,366::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-572::DEBUG::2012-11-29 15:10:11,366::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-572::DEBUG::2012-11-29 15:10:11,366::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-572::DEBUG::2012-11-29 15:10:11,381::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2012-11-29 15:10:11,381::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-572::DEBUG::2012-11-29 15:10:11,383::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-572::DEBUG::2012-11-29 15:10:11,385::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-572::DEBUG::2012-11-29 15:10:11,387::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-572::DEBUG::2012-11-29 15:10:11,389::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-572::DEBUG::2012-11-29 15:10:11,391::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-572::DEBUG::2012-11-29 15:10:11,393::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-572::DEBUG::2012-11-29 15:10:11,395::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-572::DEBUG::2012-11-29 15:10:11,397::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-572::DEBUG::2012-11-29 15:10:13,400::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-572::DEBUG::2012-11-29 15:10:13,454::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2012-11-29 15:10:13,454::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-572::DEBUG::2012-11-29 15:10:13,455::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-572::DEBUG::2012-11-29 15:10:13,455::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-572::DEBUG::2012-11-29 15:10:13,455::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-572::DEBUG::2012-11-29 15:10:13,455::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-572::DEBUG::2012-11-29 15:10:13,456::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-572::DEBUG::2012-11-29 15:10:13,456::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-572::DEBUG::2012-11-29 15:10:13,456::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-572::DEBUG::2012-11-29 15:10:13,457::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-572::DEBUG::2012-11-29 15:10:13,600::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-572::DEBUG::2012-11-29 15:10:13,600::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-572::INFO::2012-11-29 15:10:13,606::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': ['8b0589fb-75aa-4da8-bd44-c57742910be4']} >Thread-572::DEBUG::2012-11-29 15:10:13,606::task::1151::TaskManager.Task::(prepare) Task=`5f15989f-e718-44b7-b898-3a6f34d95735`::finished: {'domlist': ['8b0589fb-75aa-4da8-bd44-c57742910be4']} >Thread-572::DEBUG::2012-11-29 15:10:13,606::task::568::TaskManager.Task::(_updateState) Task=`5f15989f-e718-44b7-b898-3a6f34d95735`::moving from state preparing -> state finished >Thread-572::DEBUG::2012-11-29 15:10:13,607::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-572::DEBUG::2012-11-29 15:10:13,607::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-572::DEBUG::2012-11-29 15:10:13,607::task::957::TaskManager.Task::(_decref) Task=`5f15989f-e718-44b7-b898-3a6f34d95735`::ref 0 aborting False >Thread-576::DEBUG::2012-11-29 15:10:13,634::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-576::DEBUG::2012-11-29 15:10:13,635::task::568::TaskManager.Task::(_updateState) Task=`def6a328-3a0b-48bd-ac57-29eede892034`::moving from state init -> state preparing >Thread-576::INFO::2012-11-29 15:10:13,635::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', options=None) >Thread-576::INFO::2012-11-29 15:10:13,635::fileSD::302::Storage.StorageDomain::(validate) sdUUID=8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-576::DEBUG::2012-11-29 15:10:13,638::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=9f4dd59c4e9f8328dfa37a1d45ec7d9c67976419'] >Thread-576::DEBUG::2012-11-29 15:10:13,639::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`9ffab64f-00dc-442b-ab7a-056ce241a32c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-576::DEBUG::2012-11-29 15:10:13,639::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'shared' >Thread-576::DEBUG::2012-11-29 15:10:13,639::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'shared' (1 active user) >Thread-576::DEBUG::2012-11-29 15:10:13,639::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`9ffab64f-00dc-442b-ab7a-056ce241a32c`::Granted request >Thread-576::DEBUG::2012-11-29 15:10:13,640::task::794::TaskManager.Task::(resourceAcquired) Task=`def6a328-3a0b-48bd-ac57-29eede892034`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (shared) >Thread-576::DEBUG::2012-11-29 15:10:13,640::task::957::TaskManager.Task::(_decref) Task=`def6a328-3a0b-48bd-ac57-29eede892034`::ref 1 aborting False >Thread-576::INFO::2012-11-29 15:10:13,642::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': '8b0589fb-75aa-4da8-bd44-c57742910be4', 'master_ver': 0, 'lver': -1, 'version': '0', 'role': 'Regular', 'remotePath': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'spm_id': -1, 'type': 'NFS', 'class': 'Iso', 'pool': [], 'name': 'ISODomainRest'}} >Thread-576::DEBUG::2012-11-29 15:10:13,643::task::1151::TaskManager.Task::(prepare) Task=`def6a328-3a0b-48bd-ac57-29eede892034`::finished: {'info': {'uuid': '8b0589fb-75aa-4da8-bd44-c57742910be4', 'master_ver': 0, 'lver': -1, 'version': '0', 'role': 'Regular', 'remotePath': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'spm_id': -1, 'type': 'NFS', 'class': 'Iso', 'pool': [], 'name': 'ISODomainRest'}} >Thread-576::DEBUG::2012-11-29 15:10:13,643::task::568::TaskManager.Task::(_updateState) Task=`def6a328-3a0b-48bd-ac57-29eede892034`::moving from state preparing -> state finished >Thread-576::DEBUG::2012-11-29 15:10:13,643::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-576::DEBUG::2012-11-29 15:10:13,643::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-576::DEBUG::2012-11-29 15:10:13,643::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-576::DEBUG::2012-11-29 15:10:13,644::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-576::DEBUG::2012-11-29 15:10:13,644::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-576::DEBUG::2012-11-29 15:10:13,644::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-576::DEBUG::2012-11-29 15:10:13,644::task::957::TaskManager.Task::(_decref) Task=`def6a328-3a0b-48bd-ac57-29eede892034`::ref 0 aborting False >Thread-577::DEBUG::2012-11-29 15:10:13,687::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-577::DEBUG::2012-11-29 15:10:13,687::task::568::TaskManager.Task::(_updateState) Task=`9f7d368e-9d98-4134-80ea-cadd30ceafb2`::moving from state init -> state preparing >Thread-577::INFO::2012-11-29 15:10:13,688::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', options=None) >Thread-577::DEBUG::2012-11-29 15:10:13,688::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`37e875fc-c83c-4fe7-823f-fd40d62f7292`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-577::DEBUG::2012-11-29 15:10:13,688::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'shared' >Thread-577::DEBUG::2012-11-29 15:10:13,688::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'shared' (1 active user) >Thread-577::DEBUG::2012-11-29 15:10:13,689::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`37e875fc-c83c-4fe7-823f-fd40d62f7292`::Granted request >Thread-577::DEBUG::2012-11-29 15:10:13,689::task::794::TaskManager.Task::(resourceAcquired) Task=`9f7d368e-9d98-4134-80ea-cadd30ceafb2`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (shared) >Thread-577::DEBUG::2012-11-29 15:10:13,689::task::957::TaskManager.Task::(_decref) Task=`9f7d368e-9d98-4134-80ea-cadd30ceafb2`::ref 1 aborting False >Thread-577::INFO::2012-11-29 15:10:13,690::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861056008192', 'disktotal': '861056008192', 'mdafree': 0}} >Thread-577::DEBUG::2012-11-29 15:10:13,690::task::1151::TaskManager.Task::(prepare) Task=`9f7d368e-9d98-4134-80ea-cadd30ceafb2`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861056008192', 'disktotal': '861056008192', 'mdafree': 0}} >Thread-577::DEBUG::2012-11-29 15:10:13,691::task::568::TaskManager.Task::(_updateState) Task=`9f7d368e-9d98-4134-80ea-cadd30ceafb2`::moving from state preparing -> state finished >Thread-577::DEBUG::2012-11-29 15:10:13,691::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-577::DEBUG::2012-11-29 15:10:13,691::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-577::DEBUG::2012-11-29 15:10:13,691::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-577::DEBUG::2012-11-29 15:10:13,691::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-577::DEBUG::2012-11-29 15:10:13,692::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-577::DEBUG::2012-11-29 15:10:13,692::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-577::DEBUG::2012-11-29 15:10:13,692::task::957::TaskManager.Task::(_decref) Task=`9f7d368e-9d98-4134-80ea-cadd30ceafb2`::ref 0 aborting False >Thread-578::DEBUG::2012-11-29 15:10:14,554::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-578::DEBUG::2012-11-29 15:10:14,555::task::568::TaskManager.Task::(_updateState) Task=`069b244d-8018-4022-b850-4bf3b094514e`::moving from state init -> state preparing >Thread-578::INFO::2012-11-29 15:10:14,555::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3', 'port': ''}], options=None) >Thread-578::INFO::2012-11-29 15:10:14,555::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-578::DEBUG::2012-11-29 15:10:14,555::task::1151::TaskManager.Task::(prepare) Task=`069b244d-8018-4022-b850-4bf3b094514e`::finished: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-578::DEBUG::2012-11-29 15:10:14,555::task::568::TaskManager.Task::(_updateState) Task=`069b244d-8018-4022-b850-4bf3b094514e`::moving from state preparing -> state finished >Thread-578::DEBUG::2012-11-29 15:10:14,556::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-578::DEBUG::2012-11-29 15:10:14,556::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-578::DEBUG::2012-11-29 15:10:14,556::task::957::TaskManager.Task::(_decref) Task=`069b244d-8018-4022-b850-4bf3b094514e`::ref 0 aborting False >Thread-579::DEBUG::2012-11-29 15:10:14,585::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-579::DEBUG::2012-11-29 15:10:14,585::task::568::TaskManager.Task::(_updateState) Task=`a6ea0c65-a61b-4536-89ba-b2df03cf7072`::moving from state init -> state preparing >Thread-579::INFO::2012-11-29 15:10:14,585::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3', 'port': ''}], options=None) >Thread-579::INFO::2012-11-29 15:10:14,587::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-579::DEBUG::2012-11-29 15:10:14,588::task::1151::TaskManager.Task::(prepare) Task=`a6ea0c65-a61b-4536-89ba-b2df03cf7072`::finished: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-579::DEBUG::2012-11-29 15:10:14,588::task::568::TaskManager.Task::(_updateState) Task=`a6ea0c65-a61b-4536-89ba-b2df03cf7072`::moving from state preparing -> state finished >Thread-579::DEBUG::2012-11-29 15:10:14,588::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-579::DEBUG::2012-11-29 15:10:14,588::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-579::DEBUG::2012-11-29 15:10:14,589::task::957::TaskManager.Task::(_decref) Task=`a6ea0c65-a61b-4536-89ba-b2df03cf7072`::ref 0 aborting False >Thread-580::DEBUG::2012-11-29 15:10:14,615::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-580::DEBUG::2012-11-29 15:10:14,615::task::568::TaskManager.Task::(_updateState) Task=`3bcf1c97-1f11-4080-9022-fc14525daf58`::moving from state init -> state preparing >Thread-580::INFO::2012-11-29 15:10:14,616::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='8b0589fb-75aa-4da8-bd44-c57742910be4', autoDetach=False, options=None) >Thread-580::DEBUG::2012-11-29 15:10:14,616::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-580::DEBUG::2012-11-29 15:10:14,616::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-580::DEBUG::2012-11-29 15:10:14,616::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-580::DEBUG::2012-11-29 15:10:14,630::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-580::DEBUG::2012-11-29 15:10:14,630::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:14,632::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:14,634::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:14,637::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:14,639::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:14,641::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:14,643::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:14,645::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:14,646::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-581::DEBUG::2012-11-29 15:10:14,766::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-581::DEBUG::2012-11-29 15:10:14,766::task::568::TaskManager.Task::(_updateState) Task=`479a326d-d239-489a-b223-76166e0e8fc8`::moving from state init -> state preparing >Thread-581::INFO::2012-11-29 15:10:14,766::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-581::INFO::2012-11-29 15:10:14,767::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-581::DEBUG::2012-11-29 15:10:14,767::task::1151::TaskManager.Task::(prepare) Task=`479a326d-d239-489a-b223-76166e0e8fc8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-581::DEBUG::2012-11-29 15:10:14,767::task::568::TaskManager.Task::(_updateState) Task=`479a326d-d239-489a-b223-76166e0e8fc8`::moving from state preparing -> state finished >Thread-581::DEBUG::2012-11-29 15:10:14,767::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-581::DEBUG::2012-11-29 15:10:14,768::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-581::DEBUG::2012-11-29 15:10:14,768::task::957::TaskManager.Task::(_decref) Task=`479a326d-d239-489a-b223-76166e0e8fc8`::ref 0 aborting False >Thread-582::DEBUG::2012-11-29 15:10:14,797::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-582::DEBUG::2012-11-29 15:10:14,797::task::568::TaskManager.Task::(_updateState) Task=`71c7de5d-7e10-46c2-abaf-f05d18dfef96`::moving from state init -> state preparing >Thread-582::INFO::2012-11-29 15:10:14,797::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-582::DEBUG::2012-11-29 15:10:14,798::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c7bcec58-55c8-4af5-9431-05a4d2eba419`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-582::DEBUG::2012-11-29 15:10:14,798::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-582::DEBUG::2012-11-29 15:10:14,798::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-582::DEBUG::2012-11-29 15:10:14,798::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c7bcec58-55c8-4af5-9431-05a4d2eba419`::Granted request >Thread-582::DEBUG::2012-11-29 15:10:14,799::task::794::TaskManager.Task::(resourceAcquired) Task=`71c7de5d-7e10-46c2-abaf-f05d18dfef96`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-582::DEBUG::2012-11-29 15:10:14,799::task::957::TaskManager.Task::(_decref) Task=`71c7de5d-7e10-46c2-abaf-f05d18dfef96`::ref 1 aborting False >Thread-582::INFO::2012-11-29 15:10:14,802::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861056008192', 'alerts': [], 'disktotal': '861058105344'}}} >Thread-582::DEBUG::2012-11-29 15:10:14,802::task::1151::TaskManager.Task::(prepare) Task=`71c7de5d-7e10-46c2-abaf-f05d18dfef96`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861056008192', 'alerts': [], 'disktotal': '861058105344'}}} >Thread-582::DEBUG::2012-11-29 15:10:14,802::task::568::TaskManager.Task::(_updateState) Task=`71c7de5d-7e10-46c2-abaf-f05d18dfef96`::moving from state preparing -> state finished >Thread-582::DEBUG::2012-11-29 15:10:14,802::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-582::DEBUG::2012-11-29 15:10:14,802::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-582::DEBUG::2012-11-29 15:10:14,803::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-582::DEBUG::2012-11-29 15:10:14,803::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-582::DEBUG::2012-11-29 15:10:14,803::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-582::DEBUG::2012-11-29 15:10:14,803::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-582::DEBUG::2012-11-29 15:10:14,804::task::957::TaskManager.Task::(_decref) Task=`71c7de5d-7e10-46c2-abaf-f05d18dfef96`::ref 0 aborting False >Thread-583::DEBUG::2012-11-29 15:10:15,415::task::568::TaskManager.Task::(_updateState) Task=`cb5326ee-dcdc-4e61-9c8f-5e840af07261`::moving from state init -> state preparing >Thread-583::INFO::2012-11-29 15:10:15,415::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-583::INFO::2012-11-29 15:10:15,415::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00199484825134', 'lastCheck': '1.7', 'code': 0, 'valid': True}} >Thread-583::DEBUG::2012-11-29 15:10:15,416::task::1151::TaskManager.Task::(prepare) Task=`cb5326ee-dcdc-4e61-9c8f-5e840af07261`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00199484825134', 'lastCheck': '1.7', 'code': 0, 'valid': True}} >Thread-583::DEBUG::2012-11-29 15:10:15,416::task::568::TaskManager.Task::(_updateState) Task=`cb5326ee-dcdc-4e61-9c8f-5e840af07261`::moving from state preparing -> state finished >Thread-583::DEBUG::2012-11-29 15:10:15,416::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-583::DEBUG::2012-11-29 15:10:15,416::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-583::DEBUG::2012-11-29 15:10:15,416::task::957::TaskManager.Task::(_decref) Task=`cb5326ee-dcdc-4e61-9c8f-5e840af07261`::ref 0 aborting False >Thread-580::DEBUG::2012-11-29 15:10:16,650::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-580::DEBUG::2012-11-29 15:10:16,695::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-580::DEBUG::2012-11-29 15:10:16,696::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`ced1aea9-7eee-4175-8cf6-faa9f6f5ad08`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-580::DEBUG::2012-11-29 15:10:16,696::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' for lock type 'exclusive' >Thread-580::DEBUG::2012-11-29 15:10:16,696::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free. Now locking as 'exclusive' (1 active user) >Thread-580::DEBUG::2012-11-29 15:10:16,697::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.8b0589fb-75aa-4da8-bd44-c57742910be4`ReqID=`ced1aea9-7eee-4175-8cf6-faa9f6f5ad08`::Granted request >Thread-580::DEBUG::2012-11-29 15:10:16,697::task::794::TaskManager.Task::(resourceAcquired) Task=`3bcf1c97-1f11-4080-9022-fc14525daf58`::_resourcesAcquired: Storage.8b0589fb-75aa-4da8-bd44-c57742910be4 (exclusive) >Thread-580::DEBUG::2012-11-29 15:10:16,698::task::957::TaskManager.Task::(_decref) Task=`3bcf1c97-1f11-4080-9022-fc14525daf58`::ref 1 aborting False >Thread-580::DEBUG::2012-11-29 15:10:16,702::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=9f4dd59c4e9f8328dfa37a1d45ec7d9c67976419'] >Thread-580::DEBUG::2012-11-29 15:10:16,702::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-580::DEBUG::2012-11-29 15:10:16,703::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-580::DEBUG::2012-11-29 15:10:16,703::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-580::DEBUG::2012-11-29 15:10:16,703::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-580::DEBUG::2012-11-29 15:10:16,703::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-580::DEBUG::2012-11-29 15:10:16,717::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-580::DEBUG::2012-11-29 15:10:16,717::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:16,718::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:16,721::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:16,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:16,725::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:16,727::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:16,729::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:16,731::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-580::DEBUG::2012-11-29 15:10:16,733::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-580::DEBUG::2012-11-29 15:10:18,736::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-580::DEBUG::2012-11-29 15:10:18,809::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-580::DEBUG::2012-11-29 15:10:18,810::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-580::DEBUG::2012-11-29 15:10:18,810::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-580::DEBUG::2012-11-29 15:10:18,810::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-580::DEBUG::2012-11-29 15:10:18,810::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-580::DEBUG::2012-11-29 15:10:18,811::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-580::DEBUG::2012-11-29 15:10:18,811::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-580::DEBUG::2012-11-29 15:10:18,811::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-580::DEBUG::2012-11-29 15:10:18,811::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-580::DEBUG::2012-11-29 15:10:18,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 8b0589fb-75aa-4da8-bd44-c57742910be4' (cwd None) >Thread-580::DEBUG::2012-11-29 15:10:18,964::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found\n'; <rc> = 5 >Thread-580::WARNING::2012-11-29 15:10:18,965::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "8b0589fb-75aa-4da8-bd44-c57742910be4" not found'] >Thread-580::DEBUG::2012-11-29 15:10:18,965::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-580::DEBUG::2012-11-29 15:10:18,971::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301/8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-580::DEBUG::2012-11-29 15:10:18,971::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-580::DEBUG::2012-11-29 15:10:18,975::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'ROLE=Regular', 'SDUUID=8b0589fb-75aa-4da8-bd44-c57742910be4', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=9f4dd59c4e9f8328dfa37a1d45ec7d9c67976419'] >Thread-580::DEBUG::2012-11-29 15:10:18,976::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-580::WARNING::2012-11-29 15:10:18,976::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 8b0589fb-75aa-4da8-bd44-c57742910be4_imageNS already registered >Thread-580::WARNING::2012-11-29 15:10:18,977::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 8b0589fb-75aa-4da8-bd44-c57742910be4_volumeNS already registered >Thread-580::INFO::2012-11-29 15:10:18,977::fileSD::404::Storage.StorageDomain::(format) Formatting domain 8b0589fb-75aa-4da8-bd44-c57742910be4 >Thread-580::INFO::2012-11-29 15:10:18,988::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-580::DEBUG::2012-11-29 15:10:18,988::task::1151::TaskManager.Task::(prepare) Task=`3bcf1c97-1f11-4080-9022-fc14525daf58`::finished: None >Thread-580::DEBUG::2012-11-29 15:10:18,988::task::568::TaskManager.Task::(_updateState) Task=`3bcf1c97-1f11-4080-9022-fc14525daf58`::moving from state preparing -> state finished >Thread-580::DEBUG::2012-11-29 15:10:18,989::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4': < ResourceRef 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', isValid: 'True' obj: 'None'>} >Thread-580::DEBUG::2012-11-29 15:10:18,989::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-580::DEBUG::2012-11-29 15:10:18,989::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' >Thread-580::DEBUG::2012-11-29 15:10:18,989::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' (0 active users) >Thread-580::DEBUG::2012-11-29 15:10:18,990::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4' is free, finding out if anyone is waiting for it. >Thread-580::DEBUG::2012-11-29 15:10:18,990::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b0589fb-75aa-4da8-bd44-c57742910be4', Clearing records. >Thread-580::DEBUG::2012-11-29 15:10:18,990::task::957::TaskManager.Task::(_decref) Task=`3bcf1c97-1f11-4080-9022-fc14525daf58`::ref 0 aborting False >Thread-590::DEBUG::2012-11-29 15:10:19,024::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-590::DEBUG::2012-11-29 15:10:19,024::task::568::TaskManager.Task::(_updateState) Task=`1e6a738d-d70e-4310-bbfa-9f0e7d561936`::moving from state init -> state preparing >Thread-590::INFO::2012-11-29 15:10:19,024::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914570896301', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3', 'port': ''}], options=None) >Thread-590::DEBUG::2012-11-29 15:10:19,025::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914570896301' (cwd None) >Thread-590::DEBUG::2012-11-29 15:10:19,056::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-590::DEBUG::2012-11-29 15:10:19,056::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-590::DEBUG::2012-11-29 15:10:19,056::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-590::DEBUG::2012-11-29 15:10:19,056::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-590::DEBUG::2012-11-29 15:10:19,057::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-590::DEBUG::2012-11-29 15:10:19,070::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-590::DEBUG::2012-11-29 15:10:19,071::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-590::DEBUG::2012-11-29 15:10:19,073::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-590::DEBUG::2012-11-29 15:10:19,075::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-590::DEBUG::2012-11-29 15:10:19,077::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-590::DEBUG::2012-11-29 15:10:19,079::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-590::DEBUG::2012-11-29 15:10:19,081::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-590::DEBUG::2012-11-29 15:10:19,083::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-590::DEBUG::2012-11-29 15:10:19,085::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-590::DEBUG::2012-11-29 15:10:19,087::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-590::DEBUG::2012-11-29 15:10:21,090::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-590::DEBUG::2012-11-29 15:10:21,135::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-590::DEBUG::2012-11-29 15:10:21,135::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-590::DEBUG::2012-11-29 15:10:21,136::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-590::DEBUG::2012-11-29 15:10:21,136::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-590::DEBUG::2012-11-29 15:10:21,136::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-590::DEBUG::2012-11-29 15:10:21,136::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-590::DEBUG::2012-11-29 15:10:21,137::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-590::DEBUG::2012-11-29 15:10:21,137::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-590::INFO::2012-11-29 15:10:21,137::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-590::DEBUG::2012-11-29 15:10:21,137::task::1151::TaskManager.Task::(prepare) Task=`1e6a738d-d70e-4310-bbfa-9f0e7d561936`::finished: {'statuslist': [{'status': 0, 'id': 'ff2ea1f4-d0a4-4746-890e-73934faf9ef3'}]} >Thread-590::DEBUG::2012-11-29 15:10:21,138::task::568::TaskManager.Task::(_updateState) Task=`1e6a738d-d70e-4310-bbfa-9f0e7d561936`::moving from state preparing -> state finished >Thread-590::DEBUG::2012-11-29 15:10:21,138::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-590::DEBUG::2012-11-29 15:10:21,138::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-590::DEBUG::2012-11-29 15:10:21,138::task::957::TaskManager.Task::(_decref) Task=`1e6a738d-d70e-4310-bbfa-9f0e7d561936`::ref 0 aborting False >Thread-593::DEBUG::2012-11-29 15:10:22,287::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-593::DEBUG::2012-11-29 15:10:22,287::task::568::TaskManager.Task::(_updateState) Task=`dd743115-cbb7-43c4-b0e5-3609117cbb31`::moving from state init -> state preparing >Thread-593::INFO::2012-11-29 15:10:22,288::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-593::INFO::2012-11-29 15:10:22,288::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-593::DEBUG::2012-11-29 15:10:22,288::task::1151::TaskManager.Task::(prepare) Task=`dd743115-cbb7-43c4-b0e5-3609117cbb31`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-593::DEBUG::2012-11-29 15:10:22,288::task::568::TaskManager.Task::(_updateState) Task=`dd743115-cbb7-43c4-b0e5-3609117cbb31`::moving from state preparing -> state finished >Thread-593::DEBUG::2012-11-29 15:10:22,288::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-593::DEBUG::2012-11-29 15:10:22,289::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-593::DEBUG::2012-11-29 15:10:22,289::task::957::TaskManager.Task::(_decref) Task=`dd743115-cbb7-43c4-b0e5-3609117cbb31`::ref 0 aborting False >Thread-594::DEBUG::2012-11-29 15:10:22,327::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-594::DEBUG::2012-11-29 15:10:22,327::task::568::TaskManager.Task::(_updateState) Task=`168aae70-1d1a-4832-8c45-dcd3bb491ba4`::moving from state init -> state preparing >Thread-594::INFO::2012-11-29 15:10:22,327::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-594::DEBUG::2012-11-29 15:10:22,329::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-594::INFO::2012-11-29 15:10:22,355::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-594::DEBUG::2012-11-29 15:10:22,355::task::1151::TaskManager.Task::(prepare) Task=`168aae70-1d1a-4832-8c45-dcd3bb491ba4`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-594::DEBUG::2012-11-29 15:10:22,355::task::568::TaskManager.Task::(_updateState) Task=`168aae70-1d1a-4832-8c45-dcd3bb491ba4`::moving from state preparing -> state finished >Thread-594::DEBUG::2012-11-29 15:10:22,355::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-594::DEBUG::2012-11-29 15:10:22,356::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-594::DEBUG::2012-11-29 15:10:22,356::task::957::TaskManager.Task::(_decref) Task=`168aae70-1d1a-4832-8c45-dcd3bb491ba4`::ref 0 aborting False >Thread-595::DEBUG::2012-11-29 15:10:22,391::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-595::DEBUG::2012-11-29 15:10:22,392::task::568::TaskManager.Task::(_updateState) Task=`1cd8bee0-a5dd-4073-9c82-c7d827736648`::moving from state init -> state preparing >Thread-595::INFO::2012-11-29 15:10:22,392::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=3, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', options=None) >Thread-595::DEBUG::2012-11-29 15:10:22,392::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-595::DEBUG::2012-11-29 15:10:22,392::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-595::DEBUG::2012-11-29 15:10:22,393::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-595::DEBUG::2012-11-29 15:10:22,393::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-595::DEBUG::2012-11-29 15:10:22,393::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-595::DEBUG::2012-11-29 15:10:22,407::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-595::DEBUG::2012-11-29 15:10:22,407::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-595::DEBUG::2012-11-29 15:10:22,409::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-595::DEBUG::2012-11-29 15:10:22,411::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-595::DEBUG::2012-11-29 15:10:22,413::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-595::DEBUG::2012-11-29 15:10:22,415::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-595::DEBUG::2012-11-29 15:10:22,417::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-595::DEBUG::2012-11-29 15:10:22,419::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-595::DEBUG::2012-11-29 15:10:22,422::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-595::DEBUG::2012-11-29 15:10:22,423::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-595::DEBUG::2012-11-29 15:10:24,427::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-595::DEBUG::2012-11-29 15:10:24,477::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-595::DEBUG::2012-11-29 15:10:24,477::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-595::DEBUG::2012-11-29 15:10:24,478::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-595::DEBUG::2012-11-29 15:10:24,478::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-595::DEBUG::2012-11-29 15:10:24,478::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-595::DEBUG::2012-11-29 15:10:24,478::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-595::DEBUG::2012-11-29 15:10:24,479::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-595::DEBUG::2012-11-29 15:10:24,479::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-595::DEBUG::2012-11-29 15:10:24,479::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-595::DEBUG::2012-11-29 15:10:24,481::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-595::DEBUG::2012-11-29 15:10:24,626::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-595::DEBUG::2012-11-29 15:10:24,626::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-595::INFO::2012-11-29 15:10:24,693::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-595::DEBUG::2012-11-29 15:10:24,693::task::1151::TaskManager.Task::(prepare) Task=`1cd8bee0-a5dd-4073-9c82-c7d827736648`::finished: {'domlist': []} >Thread-595::DEBUG::2012-11-29 15:10:24,693::task::568::TaskManager.Task::(_updateState) Task=`1cd8bee0-a5dd-4073-9c82-c7d827736648`::moving from state preparing -> state finished >Thread-595::DEBUG::2012-11-29 15:10:24,693::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-595::DEBUG::2012-11-29 15:10:24,694::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-595::DEBUG::2012-11-29 15:10:24,694::task::957::TaskManager.Task::(_decref) Task=`1cd8bee0-a5dd-4073-9c82-c7d827736648`::ref 0 aborting False >Thread-599::DEBUG::2012-11-29 15:10:24,759::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-599::DEBUG::2012-11-29 15:10:24,759::task::568::TaskManager.Task::(_updateState) Task=`f2134eb1-d928-45d4-9c55-76ca44880c5a`::moving from state init -> state preparing >Thread-599::INFO::2012-11-29 15:10:24,760::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', domainName='ExportDomainRest', typeSpecificArg='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', domClass=3, domVersion='0', options=None) >Thread-599::DEBUG::2012-11-29 15:10:24,760::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-599::DEBUG::2012-11-29 15:10:24,761::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-600::DEBUG::2012-11-29 15:10:24,843::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-600::DEBUG::2012-11-29 15:10:24,844::task::568::TaskManager.Task::(_updateState) Task=`d333dcf7-1238-4702-b7cb-8ebd5b99a193`::moving from state init -> state preparing >Thread-600::INFO::2012-11-29 15:10:24,844::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-600::INFO::2012-11-29 15:10:24,845::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-600::DEBUG::2012-11-29 15:10:24,845::task::1151::TaskManager.Task::(prepare) Task=`d333dcf7-1238-4702-b7cb-8ebd5b99a193`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-600::DEBUG::2012-11-29 15:10:24,846::task::568::TaskManager.Task::(_updateState) Task=`d333dcf7-1238-4702-b7cb-8ebd5b99a193`::moving from state preparing -> state finished >Thread-600::DEBUG::2012-11-29 15:10:24,846::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-600::DEBUG::2012-11-29 15:10:24,846::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-600::DEBUG::2012-11-29 15:10:24,847::task::957::TaskManager.Task::(_decref) Task=`d333dcf7-1238-4702-b7cb-8ebd5b99a193`::ref 0 aborting False >Thread-601::DEBUG::2012-11-29 15:10:24,873::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-601::DEBUG::2012-11-29 15:10:24,874::task::568::TaskManager.Task::(_updateState) Task=`00bd2324-4b8e-4c48-897e-0059fa69c68f`::moving from state init -> state preparing >Thread-601::INFO::2012-11-29 15:10:24,874::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-601::DEBUG::2012-11-29 15:10:24,875::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`49e055cf-d47d-44eb-968f-bfe82fedb151`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-601::DEBUG::2012-11-29 15:10:24,875::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-601::DEBUG::2012-11-29 15:10:24,876::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-601::DEBUG::2012-11-29 15:10:24,876::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`49e055cf-d47d-44eb-968f-bfe82fedb151`::Granted request >Thread-601::DEBUG::2012-11-29 15:10:24,877::task::794::TaskManager.Task::(resourceAcquired) Task=`00bd2324-4b8e-4c48-897e-0059fa69c68f`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-601::DEBUG::2012-11-29 15:10:24,877::task::957::TaskManager.Task::(_decref) Task=`00bd2324-4b8e-4c48-897e-0059fa69c68f`::ref 1 aborting False >Thread-601::INFO::2012-11-29 15:10:24,883::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861053911040', 'alerts': [], 'disktotal': '861056008192'}}} >Thread-601::DEBUG::2012-11-29 15:10:24,883::task::1151::TaskManager.Task::(prepare) Task=`00bd2324-4b8e-4c48-897e-0059fa69c68f`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861053911040', 'alerts': [], 'disktotal': '861056008192'}}} >Thread-601::DEBUG::2012-11-29 15:10:24,883::task::568::TaskManager.Task::(_updateState) Task=`00bd2324-4b8e-4c48-897e-0059fa69c68f`::moving from state preparing -> state finished >Thread-601::DEBUG::2012-11-29 15:10:24,884::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-601::DEBUG::2012-11-29 15:10:24,884::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-601::DEBUG::2012-11-29 15:10:24,885::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-601::DEBUG::2012-11-29 15:10:24,885::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-601::DEBUG::2012-11-29 15:10:24,885::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-601::DEBUG::2012-11-29 15:10:24,886::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-601::DEBUG::2012-11-29 15:10:24,886::task::957::TaskManager.Task::(_decref) Task=`00bd2324-4b8e-4c48-897e-0059fa69c68f`::ref 0 aborting False >Thread-599::DEBUG::2012-11-29 15:10:24,922::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-599::WARNING::2012-11-29 15:10:24,923::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-599::DEBUG::2012-11-29 15:10:24,923::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-599::INFO::2012-11-29 15:10:24,926::nfsSD::68::Storage.StorageDomain::(create) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d domainName=ExportDomainRest remotePath=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529 domClass=3 >Thread-599::DEBUG::2012-11-29 15:10:25,074::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-599::DEBUG::2012-11-29 15:10:25,075::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-599::WARNING::2012-11-29 15:10:25,076::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-599::DEBUG::2012-11-29 15:10:25,076::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-599::DEBUG::2012-11-29 15:10:25,076::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-599::DEBUG::2012-11-29 15:10:25,076::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77af27da93e3f04fd9bb7826d58d77e301d7fc18'] >Thread-599::DEBUG::2012-11-29 15:10:25,079::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-599::DEBUG::2012-11-29 15:10:25,080::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-599::DEBUG::2012-11-29 15:10:25,081::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-599::DEBUG::2012-11-29 15:10:25,084::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77af27da93e3f04fd9bb7826d58d77e301d7fc18'] >Thread-599::DEBUG::2012-11-29 15:10:25,086::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-599::DEBUG::2012-11-29 15:10:25,086::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '76a4921b-744d-4d18-9b01-f1754c79020d_imageNS' >Thread-599::DEBUG::2012-11-29 15:10:25,086::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace '76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS' >Thread-599::DEBUG::2012-11-29 15:10:25,087::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-599::DEBUG::2012-11-29 15:10:25,092::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-599::DEBUG::2012-11-29 15:10:25,093::sd::396::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-599::INFO::2012-11-29 15:10:25,093::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-599::DEBUG::2012-11-29 15:10:25,093::task::1151::TaskManager.Task::(prepare) Task=`f2134eb1-d928-45d4-9c55-76ca44880c5a`::finished: None >Thread-599::DEBUG::2012-11-29 15:10:25,093::task::568::TaskManager.Task::(_updateState) Task=`f2134eb1-d928-45d4-9c55-76ca44880c5a`::moving from state preparing -> state finished >Thread-599::DEBUG::2012-11-29 15:10:25,094::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-599::DEBUG::2012-11-29 15:10:25,094::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-599::DEBUG::2012-11-29 15:10:25,094::task::957::TaskManager.Task::(_decref) Task=`f2134eb1-d928-45d4-9c55-76ca44880c5a`::ref 0 aborting False >Thread-604::DEBUG::2012-11-29 15:10:25,121::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-604::DEBUG::2012-11-29 15:10:25,121::task::568::TaskManager.Task::(_updateState) Task=`aa7265ba-4cd2-4fa1-b8f2-89d2b129a922`::moving from state init -> state preparing >Thread-604::INFO::2012-11-29 15:10:25,122::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', options=None) >Thread-604::DEBUG::2012-11-29 15:10:25,122::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`8143bdc5-8fe7-4764-80ac-bbe904ae51cf`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-604::DEBUG::2012-11-29 15:10:25,122::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'shared' >Thread-604::DEBUG::2012-11-29 15:10:25,123::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'shared' (1 active user) >Thread-604::DEBUG::2012-11-29 15:10:25,123::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`8143bdc5-8fe7-4764-80ac-bbe904ae51cf`::Granted request >Thread-604::DEBUG::2012-11-29 15:10:25,123::task::794::TaskManager.Task::(resourceAcquired) Task=`aa7265ba-4cd2-4fa1-b8f2-89d2b129a922`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (shared) >Thread-604::DEBUG::2012-11-29 15:10:25,123::task::957::TaskManager.Task::(_decref) Task=`aa7265ba-4cd2-4fa1-b8f2-89d2b129a922`::ref 1 aborting False >Thread-604::INFO::2012-11-29 15:10:25,124::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861053911040', 'disktotal': '861053911040', 'mdafree': 0}} >Thread-604::DEBUG::2012-11-29 15:10:25,125::task::1151::TaskManager.Task::(prepare) Task=`aa7265ba-4cd2-4fa1-b8f2-89d2b129a922`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861053911040', 'disktotal': '861053911040', 'mdafree': 0}} >Thread-604::DEBUG::2012-11-29 15:10:25,125::task::568::TaskManager.Task::(_updateState) Task=`aa7265ba-4cd2-4fa1-b8f2-89d2b129a922`::moving from state preparing -> state finished >Thread-604::DEBUG::2012-11-29 15:10:25,125::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-604::DEBUG::2012-11-29 15:10:25,125::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-604::DEBUG::2012-11-29 15:10:25,125::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-604::DEBUG::2012-11-29 15:10:25,126::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-604::DEBUG::2012-11-29 15:10:25,126::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-604::DEBUG::2012-11-29 15:10:25,126::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-604::DEBUG::2012-11-29 15:10:25,126::task::957::TaskManager.Task::(_decref) Task=`aa7265ba-4cd2-4fa1-b8f2-89d2b129a922`::ref 0 aborting False >Thread-605::DEBUG::2012-11-29 15:10:25,663::task::568::TaskManager.Task::(_updateState) Task=`221e39e4-932c-441a-b865-b9b9ca3bf682`::moving from state init -> state preparing >Thread-605::INFO::2012-11-29 15:10:25,663::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-605::INFO::2012-11-29 15:10:25,664::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00251698493958', 'lastCheck': '2.0', 'code': 0, 'valid': True}} >Thread-605::DEBUG::2012-11-29 15:10:25,664::task::1151::TaskManager.Task::(prepare) Task=`221e39e4-932c-441a-b865-b9b9ca3bf682`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00251698493958', 'lastCheck': '2.0', 'code': 0, 'valid': True}} >Thread-605::DEBUG::2012-11-29 15:10:25,664::task::568::TaskManager.Task::(_updateState) Task=`221e39e4-932c-441a-b865-b9b9ca3bf682`::moving from state preparing -> state finished >Thread-605::DEBUG::2012-11-29 15:10:25,664::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-605::DEBUG::2012-11-29 15:10:25,664::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-605::DEBUG::2012-11-29 15:10:25,665::task::957::TaskManager.Task::(_decref) Task=`221e39e4-932c-441a-b865-b9b9ca3bf682`::ref 0 aborting False >Thread-607::DEBUG::2012-11-29 15:10:26,138::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-607::DEBUG::2012-11-29 15:10:26,138::task::568::TaskManager.Task::(_updateState) Task=`56d4769e-fbee-405f-9661-a51474a3be6b`::moving from state init -> state preparing >Thread-607::INFO::2012-11-29 15:10:26,139::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a', 'port': ''}], options=None) >Thread-607::INFO::2012-11-29 15:10:26,139::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-607::DEBUG::2012-11-29 15:10:26,139::task::1151::TaskManager.Task::(prepare) Task=`56d4769e-fbee-405f-9661-a51474a3be6b`::finished: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-607::DEBUG::2012-11-29 15:10:26,139::task::568::TaskManager.Task::(_updateState) Task=`56d4769e-fbee-405f-9661-a51474a3be6b`::moving from state preparing -> state finished >Thread-607::DEBUG::2012-11-29 15:10:26,139::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-607::DEBUG::2012-11-29 15:10:26,140::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-607::DEBUG::2012-11-29 15:10:26,140::task::957::TaskManager.Task::(_decref) Task=`56d4769e-fbee-405f-9661-a51474a3be6b`::ref 0 aborting False >Thread-608::DEBUG::2012-11-29 15:10:26,168::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-608::DEBUG::2012-11-29 15:10:26,168::task::568::TaskManager.Task::(_updateState) Task=`6df9c610-d635-4eaf-b731-d5dbcef1606e`::moving from state init -> state preparing >Thread-608::INFO::2012-11-29 15:10:26,168::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a', 'port': ''}], options=None) >Thread-608::INFO::2012-11-29 15:10:26,171::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-608::DEBUG::2012-11-29 15:10:26,171::task::1151::TaskManager.Task::(prepare) Task=`6df9c610-d635-4eaf-b731-d5dbcef1606e`::finished: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-608::DEBUG::2012-11-29 15:10:26,171::task::568::TaskManager.Task::(_updateState) Task=`6df9c610-d635-4eaf-b731-d5dbcef1606e`::moving from state preparing -> state finished >Thread-608::DEBUG::2012-11-29 15:10:26,171::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-608::DEBUG::2012-11-29 15:10:26,171::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-608::DEBUG::2012-11-29 15:10:26,172::task::957::TaskManager.Task::(_decref) Task=`6df9c610-d635-4eaf-b731-d5dbcef1606e`::ref 0 aborting False >Thread-609::DEBUG::2012-11-29 15:10:26,199::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-609::DEBUG::2012-11-29 15:10:26,199::task::568::TaskManager.Task::(_updateState) Task=`6fe86e3f-8261-47f1-a3b9-ff035c52c0d9`::moving from state init -> state preparing >Thread-609::INFO::2012-11-29 15:10:26,199::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-609::DEBUG::2012-11-29 15:10:26,200::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`3f374f36-84fd-4334-b7d5-627d900f9e94`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-609::DEBUG::2012-11-29 15:10:26,200::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-609::DEBUG::2012-11-29 15:10:26,200::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-609::DEBUG::2012-11-29 15:10:26,200::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`3f374f36-84fd-4334-b7d5-627d900f9e94`::Granted request >Thread-609::DEBUG::2012-11-29 15:10:26,201::task::794::TaskManager.Task::(resourceAcquired) Task=`6fe86e3f-8261-47f1-a3b9-ff035c52c0d9`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-609::DEBUG::2012-11-29 15:10:26,201::task::957::TaskManager.Task::(_decref) Task=`6fe86e3f-8261-47f1-a3b9-ff035c52c0d9`::ref 1 aborting False >Thread-609::DEBUG::2012-11-29 15:10:26,201::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`58812adc-7993-4518-9374-dfe14803900a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-609::DEBUG::2012-11-29 15:10:26,201::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-609::DEBUG::2012-11-29 15:10:26,202::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-609::DEBUG::2012-11-29 15:10:26,202::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`58812adc-7993-4518-9374-dfe14803900a`::Granted request >Thread-609::DEBUG::2012-11-29 15:10:26,202::task::794::TaskManager.Task::(resourceAcquired) Task=`6fe86e3f-8261-47f1-a3b9-ff035c52c0d9`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-609::DEBUG::2012-11-29 15:10:26,202::task::957::TaskManager.Task::(_decref) Task=`6fe86e3f-8261-47f1-a3b9-ff035c52c0d9`::ref 1 aborting False >Thread-609::INFO::2012-11-29 15:10:26,203::sp::918::Storage.StoragePool::(attachSD) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-609::DEBUG::2012-11-29 15:10:26,205::safelease::94::ClusterLock::(acquire) Acquiring cluster lock for domain 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-609::DEBUG::2012-11-29 15:10:26,206::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c1 -n0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 76a4921b-744d-4d18-9b01-f1754c79020d 1 5 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-609::DEBUG::2012-11-29 15:10:28,236::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-609::DEBUG::2012-11-29 15:10:28,236::safelease::109::ClusterLock::(acquire) Clustered lock acquired successfully >Thread-609::DEBUG::2012-11-29 15:10:28,239::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77af27da93e3f04fd9bb7826d58d77e301d7fc18'] >Thread-609::DEBUG::2012-11-29 15:10:28,240::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-609::DEBUG::2012-11-29 15:10:28,240::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-609::DEBUG::2012-11-29 15:10:28,240::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=f8fa70213032d4231571e8e0692130dd3554d764'] >Thread-609::DEBUG::2012-11-29 15:10:28,243::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-609::DEBUG::2012-11-29 15:10:28,244::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-609::DEBUG::2012-11-29 15:10:28,244::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-609::DEBUG::2012-11-29 15:10:28,244::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=c8b31d43bf6bb6fb632b9163cb98fe4c4ec7bad4'] >Thread-609::DEBUG::2012-11-29 15:10:28,247::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-609::INFO::2012-11-29 15:10:28,248::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-609::DEBUG::2012-11-29 15:10:28,248::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-609::DEBUG::2012-11-29 15:10:28,248::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-609::DEBUG::2012-11-29 15:10:28,248::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-609::DEBUG::2012-11-29 15:10:28,249::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-609::DEBUG::2012-11-29 15:10:28,249::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-609::DEBUG::2012-11-29 15:10:28,252::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-609::INFO::2012-11-29 15:10:28,252::safelease::119::ClusterLock::(release) Releasing cluster lock for domain 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-609::DEBUG::2012-11-29 15:10:28,252::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd /usr/libexec/vdsm) >Thread-609::DEBUG::2012-11-29 15:10:29,303::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-609::DEBUG::2012-11-29 15:10:29,303::safelease::126::ClusterLock::(release) Cluster lock released successfully >Thread-609::DEBUG::2012-11-29 15:10:29,304::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-609::DEBUG::2012-11-29 15:10:29,304::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-609::DEBUG::2012-11-29 15:10:29,304::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-609::INFO::2012-11-29 15:10:29,304::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-609::DEBUG::2012-11-29 15:10:29,305::task::1151::TaskManager.Task::(prepare) Task=`6fe86e3f-8261-47f1-a3b9-ff035c52c0d9`::finished: None >Thread-609::DEBUG::2012-11-29 15:10:29,305::task::568::TaskManager.Task::(_updateState) Task=`6fe86e3f-8261-47f1-a3b9-ff035c52c0d9`::moving from state preparing -> state finished >Thread-609::DEBUG::2012-11-29 15:10:29,305::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-609::DEBUG::2012-11-29 15:10:29,305::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-609::DEBUG::2012-11-29 15:10:29,306::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-609::DEBUG::2012-11-29 15:10:29,306::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-609::DEBUG::2012-11-29 15:10:29,306::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-609::DEBUG::2012-11-29 15:10:29,306::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-609::DEBUG::2012-11-29 15:10:29,307::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-609::DEBUG::2012-11-29 15:10:29,307::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-609::DEBUG::2012-11-29 15:10:29,307::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-609::DEBUG::2012-11-29 15:10:29,307::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-609::DEBUG::2012-11-29 15:10:29,307::task::957::TaskManager.Task::(_decref) Task=`6fe86e3f-8261-47f1-a3b9-ff035c52c0d9`::ref 0 aborting False >Thread-612::DEBUG::2012-11-29 15:10:30,817::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-612::DEBUG::2012-11-29 15:10:30,818::task::568::TaskManager.Task::(_updateState) Task=`3b234b61-b56b-4f3e-891d-fd55b6bb2ec7`::moving from state init -> state preparing >Thread-612::INFO::2012-11-29 15:10:30,818::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a', 'port': ''}], options=None) >Thread-612::INFO::2012-11-29 15:10:30,818::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-612::DEBUG::2012-11-29 15:10:30,818::task::1151::TaskManager.Task::(prepare) Task=`3b234b61-b56b-4f3e-891d-fd55b6bb2ec7`::finished: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-612::DEBUG::2012-11-29 15:10:30,818::task::568::TaskManager.Task::(_updateState) Task=`3b234b61-b56b-4f3e-891d-fd55b6bb2ec7`::moving from state preparing -> state finished >Thread-612::DEBUG::2012-11-29 15:10:30,818::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-612::DEBUG::2012-11-29 15:10:30,819::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-612::DEBUG::2012-11-29 15:10:30,819::task::957::TaskManager.Task::(_decref) Task=`3b234b61-b56b-4f3e-891d-fd55b6bb2ec7`::ref 0 aborting False >Thread-613::DEBUG::2012-11-29 15:10:30,848::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-613::DEBUG::2012-11-29 15:10:30,849::task::568::TaskManager.Task::(_updateState) Task=`fd139572-e584-4028-9f18-2b64a5229455`::moving from state init -> state preparing >Thread-613::INFO::2012-11-29 15:10:30,849::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a', 'port': ''}], options=None) >Thread-613::INFO::2012-11-29 15:10:30,851::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-613::DEBUG::2012-11-29 15:10:30,851::task::1151::TaskManager.Task::(prepare) Task=`fd139572-e584-4028-9f18-2b64a5229455`::finished: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-613::DEBUG::2012-11-29 15:10:30,851::task::568::TaskManager.Task::(_updateState) Task=`fd139572-e584-4028-9f18-2b64a5229455`::moving from state preparing -> state finished >Thread-613::DEBUG::2012-11-29 15:10:30,851::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-613::DEBUG::2012-11-29 15:10:30,851::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-613::DEBUG::2012-11-29 15:10:30,852::task::957::TaskManager.Task::(_decref) Task=`fd139572-e584-4028-9f18-2b64a5229455`::ref 0 aborting False >Thread-614::DEBUG::2012-11-29 15:10:30,882::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-614::DEBUG::2012-11-29 15:10:30,882::task::568::TaskManager.Task::(_updateState) Task=`b1c50d18-9b74-4df0-b219-d3da6f40b619`::moving from state init -> state preparing >Thread-614::INFO::2012-11-29 15:10:30,882::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-614::DEBUG::2012-11-29 15:10:30,882::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`42fe7f28-5356-4d41-9a46-8ae0c29f57bc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-614::DEBUG::2012-11-29 15:10:30,883::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-614::DEBUG::2012-11-29 15:10:30,883::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-614::DEBUG::2012-11-29 15:10:30,883::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`42fe7f28-5356-4d41-9a46-8ae0c29f57bc`::Granted request >Thread-614::DEBUG::2012-11-29 15:10:30,883::task::794::TaskManager.Task::(resourceAcquired) Task=`b1c50d18-9b74-4df0-b219-d3da6f40b619`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-614::DEBUG::2012-11-29 15:10:30,883::task::957::TaskManager.Task::(_decref) Task=`b1c50d18-9b74-4df0-b219-d3da6f40b619`::ref 1 aborting False >Thread-614::DEBUG::2012-11-29 15:10:30,884::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`75a0ff10-81fd-4af5-8a94-351a6a1432e9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-614::DEBUG::2012-11-29 15:10:30,884::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-614::DEBUG::2012-11-29 15:10:30,884::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-614::DEBUG::2012-11-29 15:10:30,884::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`75a0ff10-81fd-4af5-8a94-351a6a1432e9`::Granted request >Thread-614::DEBUG::2012-11-29 15:10:30,885::task::794::TaskManager.Task::(resourceAcquired) Task=`b1c50d18-9b74-4df0-b219-d3da6f40b619`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-614::DEBUG::2012-11-29 15:10:30,885::task::957::TaskManager.Task::(_decref) Task=`b1c50d18-9b74-4df0-b219-d3da6f40b619`::ref 1 aborting False >Thread-614::INFO::2012-11-29 15:10:30,885::sp::1045::Storage.StoragePool::(activateSD) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-614::DEBUG::2012-11-29 15:10:30,889::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-614::DEBUG::2012-11-29 15:10:30,889::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-614::DEBUG::2012-11-29 15:10:30,890::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a3beb2d773238f993183d72ca3f6b0726c687262'] >Thread-614::DEBUG::2012-11-29 15:10:30,893::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-614::INFO::2012-11-29 15:10:30,893::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-614::DEBUG::2012-11-29 15:10:30,893::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-614::DEBUG::2012-11-29 15:10:30,894::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-614::DEBUG::2012-11-29 15:10:30,894::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-614::DEBUG::2012-11-29 15:10:30,894::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-614::DEBUG::2012-11-29 15:10:30,894::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-614::DEBUG::2012-11-29 15:10:30,894::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-615::DEBUG::2012-11-29 15:10:30,895::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-614::DEBUG::2012-11-29 15:10:30,895::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` started monitoring domain `76a4921b-744d-4d18-9b01-f1754c79020d` >Thread-614::DEBUG::2012-11-29 15:10:30,896::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-614::INFO::2012-11-29 15:10:30,896::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-614::DEBUG::2012-11-29 15:10:30,896::task::1151::TaskManager.Task::(prepare) Task=`b1c50d18-9b74-4df0-b219-d3da6f40b619`::finished: None >Thread-614::DEBUG::2012-11-29 15:10:30,897::task::568::TaskManager.Task::(_updateState) Task=`b1c50d18-9b74-4df0-b219-d3da6f40b619`::moving from state preparing -> state finished >Thread-614::DEBUG::2012-11-29 15:10:30,898::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-614::DEBUG::2012-11-29 15:10:30,898::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-614::DEBUG::2012-11-29 15:10:30,899::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-614::DEBUG::2012-11-29 15:10:30,899::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-614::DEBUG::2012-11-29 15:10:30,899::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-614::DEBUG::2012-11-29 15:10:30,899::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-614::DEBUG::2012-11-29 15:10:30,900::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-614::DEBUG::2012-11-29 15:10:30,900::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-614::DEBUG::2012-11-29 15:10:30,900::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-614::DEBUG::2012-11-29 15:10:30,901::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-614::DEBUG::2012-11-29 15:10:30,901::task::957::TaskManager.Task::(_decref) Task=`b1c50d18-9b74-4df0-b219-d3da6f40b619`::ref 0 aborting False >Thread-616::DEBUG::2012-11-29 15:10:30,944::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-616::DEBUG::2012-11-29 15:10:30,944::task::568::TaskManager.Task::(_updateState) Task=`6067a4a1-4e75-4089-885b-a06e2003ac3c`::moving from state init -> state preparing >Thread-616::INFO::2012-11-29 15:10:30,944::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-616::DEBUG::2012-11-29 15:10:30,945::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`cbb40ac7-76c3-4d78-a485-829f1a1bd77b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-616::DEBUG::2012-11-29 15:10:30,945::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-616::DEBUG::2012-11-29 15:10:30,945::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-616::DEBUG::2012-11-29 15:10:30,945::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`cbb40ac7-76c3-4d78-a485-829f1a1bd77b`::Granted request >Thread-616::DEBUG::2012-11-29 15:10:30,946::task::794::TaskManager.Task::(resourceAcquired) Task=`6067a4a1-4e75-4089-885b-a06e2003ac3c`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-616::DEBUG::2012-11-29 15:10:30,946::task::957::TaskManager.Task::(_decref) Task=`6067a4a1-4e75-4089-885b-a06e2003ac3c`::ref 1 aborting False >Thread-616::INFO::2012-11-29 15:10:30,946::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-616::DEBUG::2012-11-29 15:10:30,949::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a3beb2d773238f993183d72ca3f6b0726c687262'] >Thread-616::DEBUG::2012-11-29 15:10:30,949::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:30,949::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:30,950::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:30,950::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:30,950::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:30,950::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:30,950::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-616::DEBUG::2012-11-29 15:10:30,951::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-616::DEBUG::2012-11-29 15:10:30,951::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-616::DEBUG::2012-11-29 15:10:30,951::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-616::DEBUG::2012-11-29 15:10:30,951::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-616::DEBUG::2012-11-29 15:10:30,970::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-616::DEBUG::2012-11-29 15:10:30,970::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-616::DEBUG::2012-11-29 15:10:30,972::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-616::DEBUG::2012-11-29 15:10:30,974::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-616::DEBUG::2012-11-29 15:10:30,976::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-616::DEBUG::2012-11-29 15:10:30,978::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-616::DEBUG::2012-11-29 15:10:30,980::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-616::DEBUG::2012-11-29 15:10:30,982::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-616::DEBUG::2012-11-29 15:10:30,984::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-616::DEBUG::2012-11-29 15:10:30,986::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-616::DEBUG::2012-11-29 15:10:32,990::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-616::DEBUG::2012-11-29 15:10:33,050::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-616::DEBUG::2012-11-29 15:10:33,051::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,051::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,051::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,052::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,052::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,052::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,052::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-616::DEBUG::2012-11-29 15:10:33,053::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,054::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-616::DEBUG::2012-11-29 15:10:33,214::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-616::WARNING::2012-11-29 15:10:33,215::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-616::DEBUG::2012-11-29 15:10:33,216::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,222::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-616::DEBUG::2012-11-29 15:10:33,222::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-616::DEBUG::2012-11-29 15:10:33,225::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a3beb2d773238f993183d72ca3f6b0726c687262'] >Thread-616::DEBUG::2012-11-29 15:10:33,226::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-616::WARNING::2012-11-29 15:10:33,227::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-616::WARNING::2012-11-29 15:10:33,227::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-616::DEBUG::2012-11-29 15:10:33,227::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-616::DEBUG::2012-11-29 15:10:33,227::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-616::DEBUG::2012-11-29 15:10:33,228::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-616::DEBUG::2012-11-29 15:10:33,228::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-616::WARNING::2012-11-29 15:10:33,228::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-616::DEBUG::2012-11-29 15:10:33,229::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-616::DEBUG::2012-11-29 15:10:33,229::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-616::DEBUG::2012-11-29 15:10:33,380::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-616::WARNING::2012-11-29 15:10:33,380::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-616::DEBUG::2012-11-29 15:10:33,381::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-616::INFO::2012-11-29 15:10:33,383::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-616::INFO::2012-11-29 15:10:33,384::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-616::INFO::2012-11-29 15:10:33,384::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-616::INFO::2012-11-29 15:10:33,385::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-616::DEBUG::2012-11-29 15:10:33,385::task::1151::TaskManager.Task::(prepare) Task=`6067a4a1-4e75-4089-885b-a06e2003ac3c`::finished: None >Thread-616::DEBUG::2012-11-29 15:10:33,385::task::568::TaskManager.Task::(_updateState) Task=`6067a4a1-4e75-4089-885b-a06e2003ac3c`::moving from state preparing -> state finished >Thread-616::DEBUG::2012-11-29 15:10:33,385::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-616::DEBUG::2012-11-29 15:10:33,385::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-616::DEBUG::2012-11-29 15:10:33,386::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-616::DEBUG::2012-11-29 15:10:33,386::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-616::DEBUG::2012-11-29 15:10:33,386::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-616::DEBUG::2012-11-29 15:10:33,386::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-616::DEBUG::2012-11-29 15:10:33,387::task::957::TaskManager.Task::(_decref) Task=`6067a4a1-4e75-4089-885b-a06e2003ac3c`::ref 0 aborting False >Thread-623::DEBUG::2012-11-29 15:10:34,805::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-623::DEBUG::2012-11-29 15:10:34,805::task::568::TaskManager.Task::(_updateState) Task=`43d5fddc-60d8-46d5-9ff4-113f7b9604b1`::moving from state init -> state preparing >Thread-623::INFO::2012-11-29 15:10:34,805::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-623::INFO::2012-11-29 15:10:34,806::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-623::DEBUG::2012-11-29 15:10:34,806::task::1151::TaskManager.Task::(prepare) Task=`43d5fddc-60d8-46d5-9ff4-113f7b9604b1`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-623::DEBUG::2012-11-29 15:10:34,806::task::568::TaskManager.Task::(_updateState) Task=`43d5fddc-60d8-46d5-9ff4-113f7b9604b1`::moving from state preparing -> state finished >Thread-623::DEBUG::2012-11-29 15:10:34,806::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-623::DEBUG::2012-11-29 15:10:34,806::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-623::DEBUG::2012-11-29 15:10:34,806::task::957::TaskManager.Task::(_decref) Task=`43d5fddc-60d8-46d5-9ff4-113f7b9604b1`::ref 0 aborting False >Thread-624::DEBUG::2012-11-29 15:10:34,843::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-624::DEBUG::2012-11-29 15:10:34,843::task::568::TaskManager.Task::(_updateState) Task=`ef5ffc13-ca27-4e5d-b5f0-97b09028db49`::moving from state init -> state preparing >Thread-624::INFO::2012-11-29 15:10:34,843::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-624::DEBUG::2012-11-29 15:10:34,846::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865' (cwd None) >Thread-624::INFO::2012-11-29 15:10:34,871::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-624::DEBUG::2012-11-29 15:10:34,871::task::1151::TaskManager.Task::(prepare) Task=`ef5ffc13-ca27-4e5d-b5f0-97b09028db49`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-624::DEBUG::2012-11-29 15:10:34,871::task::568::TaskManager.Task::(_updateState) Task=`ef5ffc13-ca27-4e5d-b5f0-97b09028db49`::moving from state preparing -> state finished >Thread-624::DEBUG::2012-11-29 15:10:34,872::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-624::DEBUG::2012-11-29 15:10:34,872::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-624::DEBUG::2012-11-29 15:10:34,872::task::957::TaskManager.Task::(_decref) Task=`ef5ffc13-ca27-4e5d-b5f0-97b09028db49`::ref 0 aborting False >Thread-625::DEBUG::2012-11-29 15:10:34,913::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-625::DEBUG::2012-11-29 15:10:34,913::task::568::TaskManager.Task::(_updateState) Task=`afc7d7a1-9de2-4428-a48d-ef26303425ae`::moving from state init -> state preparing >Thread-625::INFO::2012-11-29 15:10:34,914::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', options=None) >Thread-625::DEBUG::2012-11-29 15:10:34,914::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-625::DEBUG::2012-11-29 15:10:34,914::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-625::DEBUG::2012-11-29 15:10:34,914::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-625::DEBUG::2012-11-29 15:10:34,915::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-625::DEBUG::2012-11-29 15:10:34,915::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-626::DEBUG::2012-11-29 15:10:34,922::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-626::DEBUG::2012-11-29 15:10:34,922::task::568::TaskManager.Task::(_updateState) Task=`d63d810f-a742-4142-a4d2-32b388f5fae1`::moving from state init -> state preparing >Thread-626::INFO::2012-11-29 15:10:34,923::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-626::INFO::2012-11-29 15:10:34,923::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-626::DEBUG::2012-11-29 15:10:34,923::task::1151::TaskManager.Task::(prepare) Task=`d63d810f-a742-4142-a4d2-32b388f5fae1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-626::DEBUG::2012-11-29 15:10:34,923::task::568::TaskManager.Task::(_updateState) Task=`d63d810f-a742-4142-a4d2-32b388f5fae1`::moving from state preparing -> state finished >Thread-626::DEBUG::2012-11-29 15:10:34,924::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-626::DEBUG::2012-11-29 15:10:34,924::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-626::DEBUG::2012-11-29 15:10:34,924::task::957::TaskManager.Task::(_decref) Task=`d63d810f-a742-4142-a4d2-32b388f5fae1`::ref 0 aborting False >Thread-625::DEBUG::2012-11-29 15:10:34,930::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-625::DEBUG::2012-11-29 15:10:34,930::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-625::DEBUG::2012-11-29 15:10:34,932::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-625::DEBUG::2012-11-29 15:10:34,934::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-625::DEBUG::2012-11-29 15:10:34,936::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-625::DEBUG::2012-11-29 15:10:34,939::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-625::DEBUG::2012-11-29 15:10:34,941::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-627::DEBUG::2012-11-29 15:10:34,943::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-627::DEBUG::2012-11-29 15:10:34,944::task::568::TaskManager.Task::(_updateState) Task=`b4fe61fb-3a53-4c96-ac02-1c626501edfd`::moving from state init -> state preparing >Thread-627::INFO::2012-11-29 15:10:34,944::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-627::DEBUG::2012-11-29 15:10:34,944::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`36524f58-4be9-436a-80f7-b010c8f326e8`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-627::DEBUG::2012-11-29 15:10:34,945::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-627::DEBUG::2012-11-29 15:10:34,945::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-627::DEBUG::2012-11-29 15:10:34,945::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`36524f58-4be9-436a-80f7-b010c8f326e8`::Granted request >Thread-627::DEBUG::2012-11-29 15:10:34,946::task::794::TaskManager.Task::(resourceAcquired) Task=`b4fe61fb-3a53-4c96-ac02-1c626501edfd`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-627::DEBUG::2012-11-29 15:10:34,946::task::957::TaskManager.Task::(_decref) Task=`b4fe61fb-3a53-4c96-ac02-1c626501edfd`::ref 1 aborting False >Thread-627::DEBUG::2012-11-29 15:10:34,949::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-628::DEBUG::2012-11-29 15:10:35,871::task::568::TaskManager.Task::(_updateState) Task=`57c2fa52-38be-4ef6-a1d5-b21896f5f342`::moving from state init -> state preparing >Thread-628::INFO::2012-11-29 15:10:35,871::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-628::INFO::2012-11-29 15:10:35,871::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00194597244263', 'lastCheck': '2.2', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.00292110443115', 'lastCheck': '5.0', 'code': 0, 'valid': True}} >Thread-628::DEBUG::2012-11-29 15:10:35,872::task::1151::TaskManager.Task::(prepare) Task=`57c2fa52-38be-4ef6-a1d5-b21896f5f342`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00194597244263', 'lastCheck': '2.2', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.00292110443115', 'lastCheck': '5.0', 'code': 0, 'valid': True}} >Thread-628::DEBUG::2012-11-29 15:10:35,872::task::568::TaskManager.Task::(_updateState) Task=`57c2fa52-38be-4ef6-a1d5-b21896f5f342`::moving from state preparing -> state finished >Thread-628::DEBUG::2012-11-29 15:10:35,872::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-628::DEBUG::2012-11-29 15:10:35,872::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-628::DEBUG::2012-11-29 15:10:35,872::task::957::TaskManager.Task::(_decref) Task=`57c2fa52-38be-4ef6-a1d5-b21896f5f342`::ref 0 aborting False >MainProcess|Thread-625::DEBUG::2012-11-29 15:10:35,944::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-625::DEBUG::2012-11-29 15:10:35,946::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-625::DEBUG::2012-11-29 15:10:35,948::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-625::DEBUG::2012-11-29 15:10:37,951::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-625::DEBUG::2012-11-29 15:10:38,004::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-625::DEBUG::2012-11-29 15:10:38,005::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-625::DEBUG::2012-11-29 15:10:38,005::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-625::DEBUG::2012-11-29 15:10:38,005::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-625::DEBUG::2012-11-29 15:10:38,006::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-625::DEBUG::2012-11-29 15:10:38,006::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-625::DEBUG::2012-11-29 15:10:38,006::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-625::DEBUG::2012-11-29 15:10:38,007::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-627::DEBUG::2012-11-29 15:10:38,007::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-625::DEBUG::2012-11-29 15:10:38,009::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:38,009::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-627::DEBUG::2012-11-29 15:10:38,011::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-627::DEBUG::2012-11-29 15:10:38,013::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-625::DEBUG::2012-11-29 15:10:38,019::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-627::DEBUG::2012-11-29 15:10:38,029::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-627::DEBUG::2012-11-29 15:10:38,029::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-627::DEBUG::2012-11-29 15:10:38,031::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-627::DEBUG::2012-11-29 15:10:38,033::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-627::DEBUG::2012-11-29 15:10:38,036::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-627::DEBUG::2012-11-29 15:10:38,038::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-627::DEBUG::2012-11-29 15:10:38,040::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-627::DEBUG::2012-11-29 15:10:38,042::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-627::DEBUG::2012-11-29 15:10:38,044::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-627::DEBUG::2012-11-29 15:10:38,046::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-625::DEBUG::2012-11-29 15:10:38,164::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-625::DEBUG::2012-11-29 15:10:38,164::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,049::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-627::DEBUG::2012-11-29 15:10:40,093::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-627::DEBUG::2012-11-29 15:10:40,093::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,094::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,094::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,094::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,094::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,095::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,095::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-627::DEBUG::2012-11-29 15:10:40,095::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,096::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-627::DEBUG::2012-11-29 15:10:40,250::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-627::WARNING::2012-11-29 15:10:40,251::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-627::DEBUG::2012-11-29 15:10:40,251::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-627::DEBUG::2012-11-29 15:10:40,260::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-627::DEBUG::2012-11-29 15:10:40,260::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-627::DEBUG::2012-11-29 15:10:40,263::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-627::DEBUG::2012-11-29 15:10:40,265::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-627::WARNING::2012-11-29 15:10:40,265::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_imageNS already registered >Thread-627::WARNING::2012-11-29 15:10:40,265::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS already registered >Thread-627::INFO::2012-11-29 15:10:40,266::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861053911040', 'alerts': [], 'disktotal': '861056008192'}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'status': 'Active', 'diskfree': '861053911040', 'alerts': [], 'disktotal': '861053911040'}}} >Thread-625::INFO::2012-11-29 15:10:40,267::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-627::DEBUG::2012-11-29 15:10:40,268::task::1151::TaskManager.Task::(prepare) Task=`b4fe61fb-3a53-4c96-ac02-1c626501edfd`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861053911040', 'alerts': [], 'disktotal': '861056008192'}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'status': 'Active', 'diskfree': '861053911040', 'alerts': [], 'disktotal': '861053911040'}}} >Thread-625::DEBUG::2012-11-29 15:10:40,268::task::1151::TaskManager.Task::(prepare) Task=`afc7d7a1-9de2-4428-a48d-ef26303425ae`::finished: {'domlist': []} >Thread-627::DEBUG::2012-11-29 15:10:40,270::task::568::TaskManager.Task::(_updateState) Task=`b4fe61fb-3a53-4c96-ac02-1c626501edfd`::moving from state preparing -> state finished >Thread-625::DEBUG::2012-11-29 15:10:40,270::task::568::TaskManager.Task::(_updateState) Task=`afc7d7a1-9de2-4428-a48d-ef26303425ae`::moving from state preparing -> state finished >Thread-625::DEBUG::2012-11-29 15:10:40,271::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-627::DEBUG::2012-11-29 15:10:40,271::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-625::DEBUG::2012-11-29 15:10:40,272::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-627::DEBUG::2012-11-29 15:10:40,273::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-625::DEBUG::2012-11-29 15:10:40,274::task::957::TaskManager.Task::(_decref) Task=`afc7d7a1-9de2-4428-a48d-ef26303425ae`::ref 0 aborting False >Thread-627::DEBUG::2012-11-29 15:10:40,276::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-627::DEBUG::2012-11-29 15:10:40,279::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-627::DEBUG::2012-11-29 15:10:40,279::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-627::DEBUG::2012-11-29 15:10:40,279::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-627::DEBUG::2012-11-29 15:10:40,279::task::957::TaskManager.Task::(_decref) Task=`b4fe61fb-3a53-4c96-ac02-1c626501edfd`::ref 0 aborting False >Thread-638::DEBUG::2012-11-29 15:10:40,351::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-638::DEBUG::2012-11-29 15:10:40,352::task::568::TaskManager.Task::(_updateState) Task=`e4a6bb36-71c1-432b-931b-d1d136fd2231`::moving from state init -> state preparing >Thread-638::INFO::2012-11-29 15:10:40,352::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', domainName='DataDomainRest2', typeSpecificArg='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', domClass=1, domVersion='3', options=None) >Thread-638::DEBUG::2012-11-29 15:10:40,352::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-638::DEBUG::2012-11-29 15:10:40,353::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-638::DEBUG::2012-11-29 15:10:40,509::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-638::WARNING::2012-11-29 15:10:40,509::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-638::DEBUG::2012-11-29 15:10:40,510::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-638::INFO::2012-11-29 15:10:40,516::nfsSD::68::Storage.StorageDomain::(create) sdUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 domainName=DataDomainRest2 remotePath=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865 domClass=1 >Thread-638::DEBUG::2012-11-29 15:10:41,248::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-638::DEBUG::2012-11-29 15:10:41,249::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-638::WARNING::2012-11-29 15:10:41,249::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-638::DEBUG::2012-11-29 15:10:41,249::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-638::DEBUG::2012-11-29 15:10:41,249::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-638::DEBUG::2012-11-29 15:10:41,250::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=50f9a8def56be96893148b5991c4477dd7382643'] >Thread-638::DEBUG::2012-11-29 15:10:41,254::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-638::DEBUG::2012-11-29 15:10:41,255::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-638::DEBUG::2012-11-29 15:10:41,255::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-638::DEBUG::2012-11-29 15:10:41,258::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=50f9a8def56be96893148b5991c4477dd7382643'] >Thread-638::DEBUG::2012-11-29 15:10:41,260::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-638::DEBUG::2012-11-29 15:10:41,260::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_imageNS' >Thread-638::DEBUG::2012-11-29 15:10:41,261::resourceManager::379::ResourceManager::(registerNamespace) Registering namespace 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_volumeNS' >Thread-638::DEBUG::2012-11-29 15:10:41,298::sd::396::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-638::INFO::2012-11-29 15:10:41,298::logUtils::39::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-638::DEBUG::2012-11-29 15:10:41,298::task::1151::TaskManager.Task::(prepare) Task=`e4a6bb36-71c1-432b-931b-d1d136fd2231`::finished: None >Thread-638::DEBUG::2012-11-29 15:10:41,298::task::568::TaskManager.Task::(_updateState) Task=`e4a6bb36-71c1-432b-931b-d1d136fd2231`::moving from state preparing -> state finished >Thread-638::DEBUG::2012-11-29 15:10:41,299::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-638::DEBUG::2012-11-29 15:10:41,299::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-638::DEBUG::2012-11-29 15:10:41,299::task::957::TaskManager.Task::(_decref) Task=`e4a6bb36-71c1-432b-931b-d1d136fd2231`::ref 0 aborting False >Thread-642::DEBUG::2012-11-29 15:10:41,326::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-642::DEBUG::2012-11-29 15:10:41,327::task::568::TaskManager.Task::(_updateState) Task=`740a69e9-177e-44d0-b4ab-fbd412385949`::moving from state init -> state preparing >Thread-642::INFO::2012-11-29 15:10:41,327::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', options=None) >Thread-642::DEBUG::2012-11-29 15:10:41,328::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`f322ad1e-c399-4992-b9d7-5e663e89194b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-642::DEBUG::2012-11-29 15:10:41,328::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' for lock type 'shared' >Thread-642::DEBUG::2012-11-29 15:10:41,328::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free. Now locking as 'shared' (1 active user) >Thread-642::DEBUG::2012-11-29 15:10:41,328::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`f322ad1e-c399-4992-b9d7-5e663e89194b`::Granted request >Thread-642::DEBUG::2012-11-29 15:10:41,329::task::794::TaskManager.Task::(resourceAcquired) Task=`740a69e9-177e-44d0-b4ab-fbd412385949`::_resourcesAcquired: Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (shared) >Thread-642::DEBUG::2012-11-29 15:10:41,329::task::957::TaskManager.Task::(_decref) Task=`740a69e9-177e-44d0-b4ab-fbd412385949`::ref 1 aborting False >Thread-642::INFO::2012-11-29 15:10:41,330::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861040279552', 'disktotal': '861040279552', 'mdafree': 0}} >Thread-642::DEBUG::2012-11-29 15:10:41,330::task::1151::TaskManager.Task::(prepare) Task=`740a69e9-177e-44d0-b4ab-fbd412385949`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861040279552', 'disktotal': '861040279552', 'mdafree': 0}} >Thread-642::DEBUG::2012-11-29 15:10:41,330::task::568::TaskManager.Task::(_updateState) Task=`740a69e9-177e-44d0-b4ab-fbd412385949`::moving from state preparing -> state finished >Thread-642::DEBUG::2012-11-29 15:10:41,331::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': < ResourceRef 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', isValid: 'True' obj: 'None'>} >Thread-642::DEBUG::2012-11-29 15:10:41,331::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-642::DEBUG::2012-11-29 15:10:41,331::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' >Thread-642::DEBUG::2012-11-29 15:10:41,331::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (0 active users) >Thread-642::DEBUG::2012-11-29 15:10:41,331::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free, finding out if anyone is waiting for it. >Thread-642::DEBUG::2012-11-29 15:10:41,332::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', Clearing records. >Thread-642::DEBUG::2012-11-29 15:10:41,332::task::957::TaskManager.Task::(_decref) Task=`740a69e9-177e-44d0-b4ab-fbd412385949`::ref 0 aborting False >Thread-644::DEBUG::2012-11-29 15:10:42,793::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-644::DEBUG::2012-11-29 15:10:42,793::task::568::TaskManager.Task::(_updateState) Task=`588c4eba-2cf3-4d70-8540-997b6b0ff27b`::moving from state init -> state preparing >Thread-644::INFO::2012-11-29 15:10:42,794::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-644::INFO::2012-11-29 15:10:42,794::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-644::DEBUG::2012-11-29 15:10:42,794::task::1151::TaskManager.Task::(prepare) Task=`588c4eba-2cf3-4d70-8540-997b6b0ff27b`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-644::DEBUG::2012-11-29 15:10:42,794::task::568::TaskManager.Task::(_updateState) Task=`588c4eba-2cf3-4d70-8540-997b6b0ff27b`::moving from state preparing -> state finished >Thread-644::DEBUG::2012-11-29 15:10:42,794::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-644::DEBUG::2012-11-29 15:10:42,795::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-644::DEBUG::2012-11-29 15:10:42,795::task::957::TaskManager.Task::(_decref) Task=`588c4eba-2cf3-4d70-8540-997b6b0ff27b`::ref 0 aborting False >Thread-645::DEBUG::2012-11-29 15:10:42,822::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-645::DEBUG::2012-11-29 15:10:42,822::task::568::TaskManager.Task::(_updateState) Task=`063a3790-feda-4728-a25f-9ea4df8da09a`::moving from state init -> state preparing >Thread-645::INFO::2012-11-29 15:10:42,822::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-645::INFO::2012-11-29 15:10:42,824::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-645::DEBUG::2012-11-29 15:10:42,824::task::1151::TaskManager.Task::(prepare) Task=`063a3790-feda-4728-a25f-9ea4df8da09a`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-645::DEBUG::2012-11-29 15:10:42,824::task::568::TaskManager.Task::(_updateState) Task=`063a3790-feda-4728-a25f-9ea4df8da09a`::moving from state preparing -> state finished >Thread-645::DEBUG::2012-11-29 15:10:42,825::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-645::DEBUG::2012-11-29 15:10:42,825::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-645::DEBUG::2012-11-29 15:10:42,825::task::957::TaskManager.Task::(_decref) Task=`063a3790-feda-4728-a25f-9ea4df8da09a`::ref 0 aborting False >Thread-646::DEBUG::2012-11-29 15:10:42,850::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-646::DEBUG::2012-11-29 15:10:42,850::task::568::TaskManager.Task::(_updateState) Task=`57f27a0a-88e0-48ec-9c77-bf05f04db774`::moving from state init -> state preparing >Thread-646::INFO::2012-11-29 15:10:42,850::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-646::DEBUG::2012-11-29 15:10:42,850::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c22b3840-689e-4541-bf15-681bcc9d4033`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-646::DEBUG::2012-11-29 15:10:42,851::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-646::DEBUG::2012-11-29 15:10:42,851::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-646::DEBUG::2012-11-29 15:10:42,851::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c22b3840-689e-4541-bf15-681bcc9d4033`::Granted request >Thread-646::DEBUG::2012-11-29 15:10:42,851::task::794::TaskManager.Task::(resourceAcquired) Task=`57f27a0a-88e0-48ec-9c77-bf05f04db774`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-646::DEBUG::2012-11-29 15:10:42,851::task::957::TaskManager.Task::(_decref) Task=`57f27a0a-88e0-48ec-9c77-bf05f04db774`::ref 1 aborting False >Thread-646::DEBUG::2012-11-29 15:10:42,852::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`896bd5b2-30a4-49d0-b8c1-81f92d9a2891`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-646::DEBUG::2012-11-29 15:10:42,852::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' for lock type 'exclusive' >Thread-646::DEBUG::2012-11-29 15:10:42,852::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free. Now locking as 'exclusive' (1 active user) >Thread-646::DEBUG::2012-11-29 15:10:42,852::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`896bd5b2-30a4-49d0-b8c1-81f92d9a2891`::Granted request >Thread-646::DEBUG::2012-11-29 15:10:42,853::task::794::TaskManager.Task::(resourceAcquired) Task=`57f27a0a-88e0-48ec-9c77-bf05f04db774`::_resourcesAcquired: Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (exclusive) >Thread-646::DEBUG::2012-11-29 15:10:42,853::task::957::TaskManager.Task::(_decref) Task=`57f27a0a-88e0-48ec-9c77-bf05f04db774`::ref 1 aborting False >Thread-646::INFO::2012-11-29 15:10:42,853::sp::918::Storage.StoragePool::(attachSD) sdUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-646::INFO::2012-11-29 15:10:42,855::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (id: 1) >Thread-648::DEBUG::2012-11-29 15:10:46,070::task::568::TaskManager.Task::(_updateState) Task=`65922f71-7151-4ab7-b132-c0d61ebffe56`::moving from state init -> state preparing >Thread-648::INFO::2012-11-29 15:10:46,075::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-648::INFO::2012-11-29 15:10:46,075::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00213289260864', 'lastCheck': '2.4', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.00208210945129', 'lastCheck': '5.2', 'code': 0, 'valid': True}} >Thread-648::DEBUG::2012-11-29 15:10:46,075::task::1151::TaskManager.Task::(prepare) Task=`65922f71-7151-4ab7-b132-c0d61ebffe56`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00213289260864', 'lastCheck': '2.4', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.00208210945129', 'lastCheck': '5.2', 'code': 0, 'valid': True}} >Thread-648::DEBUG::2012-11-29 15:10:46,075::task::568::TaskManager.Task::(_updateState) Task=`65922f71-7151-4ab7-b132-c0d61ebffe56`::moving from state preparing -> state finished >Thread-648::DEBUG::2012-11-29 15:10:46,075::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-648::DEBUG::2012-11-29 15:10:46,076::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-648::DEBUG::2012-11-29 15:10:46,076::task::957::TaskManager.Task::(_decref) Task=`65922f71-7151-4ab7-b132-c0d61ebffe56`::ref 0 aborting False >Thread-654::DEBUG::2012-11-29 15:10:56,274::task::568::TaskManager.Task::(_updateState) Task=`89390f58-a322-48cd-bfe5-6f0fcb3ed405`::moving from state init -> state preparing >Thread-654::INFO::2012-11-29 15:10:56,275::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-654::INFO::2012-11-29 15:10:56,275::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00252485275269', 'lastCheck': '2.6', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.0026638507843', 'lastCheck': '5.4', 'code': 0, 'valid': True}} >Thread-654::DEBUG::2012-11-29 15:10:56,275::task::1151::TaskManager.Task::(prepare) Task=`89390f58-a322-48cd-bfe5-6f0fcb3ed405`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00252485275269', 'lastCheck': '2.6', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.0026638507843', 'lastCheck': '5.4', 'code': 0, 'valid': True}} >Thread-654::DEBUG::2012-11-29 15:10:56,275::task::568::TaskManager.Task::(_updateState) Task=`89390f58-a322-48cd-bfe5-6f0fcb3ed405`::moving from state preparing -> state finished >Thread-654::DEBUG::2012-11-29 15:10:56,275::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-654::DEBUG::2012-11-29 15:10:56,276::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-654::DEBUG::2012-11-29 15:10:56,276::task::957::TaskManager.Task::(_decref) Task=`89390f58-a322-48cd-bfe5-6f0fcb3ed405`::ref 0 aborting False >Thread-646::DEBUG::2012-11-29 15:11:03,858::safelease::178::SANLock::(acquireHostId) Host id for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 successfully acquired (id: 1) >Thread-646::INFO::2012-11-29 15:11:03,859::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (id: 1) >Thread-646::DEBUG::2012-11-29 15:11:03,894::safelease::235::SANLock::(acquire) Cluster lock for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 successfully acquired (id: 1) >Thread-646::DEBUG::2012-11-29 15:11:03,897::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=50f9a8def56be96893148b5991c4477dd7382643'] >Thread-646::DEBUG::2012-11-29 15:11:03,897::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-646::DEBUG::2012-11-29 15:11:03,897::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-646::DEBUG::2012-11-29 15:11:03,898::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3c0dc643f03375199a32c6bc004e05ec6dd8f3c0'] >Thread-646::DEBUG::2012-11-29 15:11:03,902::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-646::DEBUG::2012-11-29 15:11:03,902::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-646::DEBUG::2012-11-29 15:11:03,903::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-646::DEBUG::2012-11-29 15:11:03,903::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=2ba44cdb1557ba13a4a398b45952cedbec15526f'] >Thread-646::DEBUG::2012-11-29 15:11:03,906::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-646::INFO::2012-11-29 15:11:03,906::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-646::DEBUG::2012-11-29 15:11:03,907::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-646::DEBUG::2012-11-29 15:11:03,907::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-646::DEBUG::2012-11-29 15:11:03,907::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-646::DEBUG::2012-11-29 15:11:03,907::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-646::DEBUG::2012-11-29 15:11:03,907::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9b0b5035d83a6ecb376ae2792c24d6f80f9f8e83'] >Thread-646::DEBUG::2012-11-29 15:11:03,910::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-646::INFO::2012-11-29 15:11:03,911::safelease::239::SANLock::(release) Releasing cluster lock for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-646::DEBUG::2012-11-29 15:11:04,415::safelease::250::SANLock::(release) Cluster lock for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 successfully released >Thread-646::INFO::2012-11-29 15:11:04,415::safelease::183::SANLock::(releaseHostId) Releasing host id for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (id: 1) >Thread-660::DEBUG::2012-11-29 15:11:06,469::task::568::TaskManager.Task::(_updateState) Task=`67e7e145-50a1-49ce-bdbb-de954d52b0fc`::moving from state init -> state preparing >Thread-660::INFO::2012-11-29 15:11:06,470::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-660::INFO::2012-11-29 15:11:06,470::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00235104560852', 'lastCheck': '2.8', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.0025999546051', 'lastCheck': '5.5', 'code': 0, 'valid': True}} >Thread-660::DEBUG::2012-11-29 15:11:06,470::task::1151::TaskManager.Task::(prepare) Task=`67e7e145-50a1-49ce-bdbb-de954d52b0fc`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00235104560852', 'lastCheck': '2.8', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.0025999546051', 'lastCheck': '5.5', 'code': 0, 'valid': True}} >Thread-660::DEBUG::2012-11-29 15:11:06,470::task::568::TaskManager.Task::(_updateState) Task=`67e7e145-50a1-49ce-bdbb-de954d52b0fc`::moving from state preparing -> state finished >Thread-660::DEBUG::2012-11-29 15:11:06,470::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-660::DEBUG::2012-11-29 15:11:06,470::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-660::DEBUG::2012-11-29 15:11:06,471::task::957::TaskManager.Task::(_decref) Task=`67e7e145-50a1-49ce-bdbb-de954d52b0fc`::ref 0 aborting False >Thread-646::DEBUG::2012-11-29 15:11:07,416::safelease::193::SANLock::(releaseHostId) Host id for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 released successfully (id: 1) >Thread-646::DEBUG::2012-11-29 15:11:07,416::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-646::DEBUG::2012-11-29 15:11:07,416::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-646::DEBUG::2012-11-29 15:11:07,416::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-646::INFO::2012-11-29 15:11:07,417::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-646::DEBUG::2012-11-29 15:11:07,417::task::1151::TaskManager.Task::(prepare) Task=`57f27a0a-88e0-48ec-9c77-bf05f04db774`::finished: None >Thread-646::DEBUG::2012-11-29 15:11:07,417::task::568::TaskManager.Task::(_updateState) Task=`57f27a0a-88e0-48ec-9c77-bf05f04db774`::moving from state preparing -> state finished >Thread-646::DEBUG::2012-11-29 15:11:07,417::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': < ResourceRef 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', isValid: 'True' obj: 'None'>, 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-646::DEBUG::2012-11-29 15:11:07,417::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-646::DEBUG::2012-11-29 15:11:07,417::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' >Thread-646::DEBUG::2012-11-29 15:11:07,418::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (0 active users) >Thread-646::DEBUG::2012-11-29 15:11:07,418::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free, finding out if anyone is waiting for it. >Thread-646::DEBUG::2012-11-29 15:11:07,418::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', Clearing records. >Thread-646::DEBUG::2012-11-29 15:11:07,418::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-646::DEBUG::2012-11-29 15:11:07,418::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-646::DEBUG::2012-11-29 15:11:07,419::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-646::DEBUG::2012-11-29 15:11:07,419::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-646::DEBUG::2012-11-29 15:11:07,419::task::957::TaskManager.Task::(_decref) Task=`57f27a0a-88e0-48ec-9c77-bf05f04db774`::ref 0 aborting False >Thread-662::DEBUG::2012-11-29 15:11:07,448::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-662::DEBUG::2012-11-29 15:11:07,448::task::568::TaskManager.Task::(_updateState) Task=`3e6852ab-16d5-4c7b-8710-ff82f0b250af`::moving from state init -> state preparing >Thread-662::INFO::2012-11-29 15:11:07,448::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-662::INFO::2012-11-29 15:11:07,449::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-662::DEBUG::2012-11-29 15:11:07,449::task::1151::TaskManager.Task::(prepare) Task=`3e6852ab-16d5-4c7b-8710-ff82f0b250af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-662::DEBUG::2012-11-29 15:11:07,449::task::568::TaskManager.Task::(_updateState) Task=`3e6852ab-16d5-4c7b-8710-ff82f0b250af`::moving from state preparing -> state finished >Thread-662::DEBUG::2012-11-29 15:11:07,449::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-662::DEBUG::2012-11-29 15:11:07,449::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-662::DEBUG::2012-11-29 15:11:07,449::task::957::TaskManager.Task::(_decref) Task=`3e6852ab-16d5-4c7b-8710-ff82f0b250af`::ref 0 aborting False >Thread-663::DEBUG::2012-11-29 15:11:07,482::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-663::DEBUG::2012-11-29 15:11:07,482::task::568::TaskManager.Task::(_updateState) Task=`4adb3fdb-f865-435e-9fb4-9f01a000b805`::moving from state init -> state preparing >Thread-663::INFO::2012-11-29 15:11:07,483::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-663::DEBUG::2012-11-29 15:11:07,483::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`1181dc5c-456d-44fb-a190-72d16f092611`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-663::DEBUG::2012-11-29 15:11:07,483::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-663::DEBUG::2012-11-29 15:11:07,483::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-663::DEBUG::2012-11-29 15:11:07,483::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`1181dc5c-456d-44fb-a190-72d16f092611`::Granted request >Thread-663::DEBUG::2012-11-29 15:11:07,484::task::794::TaskManager.Task::(resourceAcquired) Task=`4adb3fdb-f865-435e-9fb4-9f01a000b805`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-663::DEBUG::2012-11-29 15:11:07,484::task::957::TaskManager.Task::(_decref) Task=`4adb3fdb-f865-435e-9fb4-9f01a000b805`::ref 1 aborting False >Thread-663::INFO::2012-11-29 15:11:07,487::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861040279552', 'alerts': [], 'disktotal': '861042376704'}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'status': 'Active', 'diskfree': '861040279552', 'alerts': [], 'disktotal': '861040279552'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Attached'}}} >Thread-663::DEBUG::2012-11-29 15:11:07,487::task::1151::TaskManager.Task::(prepare) Task=`4adb3fdb-f865-435e-9fb4-9f01a000b805`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861040279552', 'alerts': [], 'disktotal': '861042376704'}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'status': 'Active', 'diskfree': '861040279552', 'alerts': [], 'disktotal': '861040279552'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Attached'}}} >Thread-663::DEBUG::2012-11-29 15:11:07,487::task::568::TaskManager.Task::(_updateState) Task=`4adb3fdb-f865-435e-9fb4-9f01a000b805`::moving from state preparing -> state finished >Thread-663::DEBUG::2012-11-29 15:11:07,487::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-663::DEBUG::2012-11-29 15:11:07,487::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-663::DEBUG::2012-11-29 15:11:07,488::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-663::DEBUG::2012-11-29 15:11:07,488::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-663::DEBUG::2012-11-29 15:11:07,488::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-663::DEBUG::2012-11-29 15:11:07,488::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-663::DEBUG::2012-11-29 15:11:07,488::task::957::TaskManager.Task::(_decref) Task=`4adb3fdb-f865-435e-9fb4-9f01a000b805`::ref 0 aborting False >Thread-665::DEBUG::2012-11-29 15:11:09,071::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-665::DEBUG::2012-11-29 15:11:09,071::task::568::TaskManager.Task::(_updateState) Task=`6c28428b-cd9d-42f4-b66e-c4af8c2225c0`::moving from state init -> state preparing >Thread-665::INFO::2012-11-29 15:11:09,072::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-665::INFO::2012-11-29 15:11:09,072::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-665::DEBUG::2012-11-29 15:11:09,072::task::1151::TaskManager.Task::(prepare) Task=`6c28428b-cd9d-42f4-b66e-c4af8c2225c0`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-665::DEBUG::2012-11-29 15:11:09,072::task::568::TaskManager.Task::(_updateState) Task=`6c28428b-cd9d-42f4-b66e-c4af8c2225c0`::moving from state preparing -> state finished >Thread-665::DEBUG::2012-11-29 15:11:09,072::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-665::DEBUG::2012-11-29 15:11:09,073::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-665::DEBUG::2012-11-29 15:11:09,073::task::957::TaskManager.Task::(_decref) Task=`6c28428b-cd9d-42f4-b66e-c4af8c2225c0`::ref 0 aborting False >Thread-666::DEBUG::2012-11-29 15:11:09,102::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-666::DEBUG::2012-11-29 15:11:09,102::task::568::TaskManager.Task::(_updateState) Task=`c6544caa-c390-4aa4-bcd8-8a2e861e7cef`::moving from state init -> state preparing >Thread-666::INFO::2012-11-29 15:11:09,103::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-666::INFO::2012-11-29 15:11:09,105::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-666::DEBUG::2012-11-29 15:11:09,105::task::1151::TaskManager.Task::(prepare) Task=`c6544caa-c390-4aa4-bcd8-8a2e861e7cef`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-666::DEBUG::2012-11-29 15:11:09,105::task::568::TaskManager.Task::(_updateState) Task=`c6544caa-c390-4aa4-bcd8-8a2e861e7cef`::moving from state preparing -> state finished >Thread-666::DEBUG::2012-11-29 15:11:09,105::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-666::DEBUG::2012-11-29 15:11:09,105::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-666::DEBUG::2012-11-29 15:11:09,105::task::957::TaskManager.Task::(_decref) Task=`c6544caa-c390-4aa4-bcd8-8a2e861e7cef`::ref 0 aborting False >Thread-667::DEBUG::2012-11-29 15:11:09,131::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-667::DEBUG::2012-11-29 15:11:09,131::task::568::TaskManager.Task::(_updateState) Task=`9c853075-69c4-413d-8c8b-7added2d6da3`::moving from state init -> state preparing >Thread-667::INFO::2012-11-29 15:11:09,132::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-667::DEBUG::2012-11-29 15:11:09,132::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`7958c159-ab3a-4a26-ba21-b2df792cccc9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-667::DEBUG::2012-11-29 15:11:09,132::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-667::DEBUG::2012-11-29 15:11:09,132::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-667::DEBUG::2012-11-29 15:11:09,132::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`7958c159-ab3a-4a26-ba21-b2df792cccc9`::Granted request >Thread-667::DEBUG::2012-11-29 15:11:09,133::task::794::TaskManager.Task::(resourceAcquired) Task=`9c853075-69c4-413d-8c8b-7added2d6da3`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-667::DEBUG::2012-11-29 15:11:09,133::task::957::TaskManager.Task::(_decref) Task=`9c853075-69c4-413d-8c8b-7added2d6da3`::ref 1 aborting False >Thread-667::DEBUG::2012-11-29 15:11:09,133::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`8ba3eaed-7fc2-4443-bd97-24364ad9cc17`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-667::DEBUG::2012-11-29 15:11:09,133::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' for lock type 'exclusive' >Thread-667::DEBUG::2012-11-29 15:11:09,134::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free. Now locking as 'exclusive' (1 active user) >Thread-667::DEBUG::2012-11-29 15:11:09,134::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`8ba3eaed-7fc2-4443-bd97-24364ad9cc17`::Granted request >Thread-667::DEBUG::2012-11-29 15:11:09,134::task::794::TaskManager.Task::(resourceAcquired) Task=`9c853075-69c4-413d-8c8b-7added2d6da3`::_resourcesAcquired: Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (exclusive) >Thread-667::DEBUG::2012-11-29 15:11:09,134::task::957::TaskManager.Task::(_decref) Task=`9c853075-69c4-413d-8c8b-7added2d6da3`::ref 1 aborting False >Thread-667::INFO::2012-11-29 15:11:09,134::sp::1045::Storage.StoragePool::(activateSD) sdUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-667::DEBUG::2012-11-29 15:11:09,135::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-667::DEBUG::2012-11-29 15:11:09,135::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-667::DEBUG::2012-11-29 15:11:09,135::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-667::DEBUG::2012-11-29 15:11:09,135::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-667::DEBUG::2012-11-29 15:11:09,135::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-667::DEBUG::2012-11-29 15:11:09,153::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-667::DEBUG::2012-11-29 15:11:09,154::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-667::DEBUG::2012-11-29 15:11:09,156::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-667::DEBUG::2012-11-29 15:11:09,158::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-667::DEBUG::2012-11-29 15:11:09,160::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-667::DEBUG::2012-11-29 15:11:09,163::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-667::DEBUG::2012-11-29 15:11:09,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-667::DEBUG::2012-11-29 15:11:09,167::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-667::DEBUG::2012-11-29 15:11:09,169::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-667::DEBUG::2012-11-29 15:11:09,171::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-667::DEBUG::2012-11-29 15:11:11,174::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-667::DEBUG::2012-11-29 15:11:11,239::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-667::DEBUG::2012-11-29 15:11:11,239::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-667::DEBUG::2012-11-29 15:11:11,240::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-667::DEBUG::2012-11-29 15:11:11,240::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-667::DEBUG::2012-11-29 15:11:11,240::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-667::DEBUG::2012-11-29 15:11:11,241::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-667::DEBUG::2012-11-29 15:11:11,241::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-667::DEBUG::2012-11-29 15:11:11,241::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-667::DEBUG::2012-11-29 15:11:11,241::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-667::DEBUG::2012-11-29 15:11:11,242::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-667::DEBUG::2012-11-29 15:11:11,399::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-667::WARNING::2012-11-29 15:11:11,400::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-667::DEBUG::2012-11-29 15:11:11,400::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-667::DEBUG::2012-11-29 15:11:11,408::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-667::DEBUG::2012-11-29 15:11:11,409::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-667::DEBUG::2012-11-29 15:11:11,412::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9b0b5035d83a6ecb376ae2792c24d6f80f9f8e83'] >Thread-667::DEBUG::2012-11-29 15:11:11,413::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-667::WARNING::2012-11-29 15:11:11,414::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_imageNS already registered >Thread-667::WARNING::2012-11-29 15:11:11,414::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_volumeNS already registered >Thread-667::DEBUG::2012-11-29 15:11:11,414::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-667::DEBUG::2012-11-29 15:11:11,415::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-667::DEBUG::2012-11-29 15:11:11,415::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=333c691f1ce6b2be7e1ace1fb553179a8a155939'] >Thread-667::DEBUG::2012-11-29 15:11:11,418::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-667::INFO::2012-11-29 15:11:11,418::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-667::DEBUG::2012-11-29 15:11:11,419::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-667::DEBUG::2012-11-29 15:11:11,419::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-667::DEBUG::2012-11-29 15:11:11,419::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-667::DEBUG::2012-11-29 15:11:11,419::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-667::DEBUG::2012-11-29 15:11:11,420::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-667::DEBUG::2012-11-29 15:11:11,420::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-667::DEBUG::2012-11-29 15:11:11,420::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` started monitoring domain `c23cb5a0-b4c5-46c1-9bc1-b49800b4de76` >Thread-672::DEBUG::2012-11-29 15:11:11,421::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-667::DEBUG::2012-11-29 15:11:11,421::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-667::INFO::2012-11-29 15:11:11,422::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-667::DEBUG::2012-11-29 15:11:11,423::task::1151::TaskManager.Task::(prepare) Task=`9c853075-69c4-413d-8c8b-7added2d6da3`::finished: None >Thread-667::DEBUG::2012-11-29 15:11:11,424::task::568::TaskManager.Task::(_updateState) Task=`9c853075-69c4-413d-8c8b-7added2d6da3`::moving from state preparing -> state finished >Thread-667::DEBUG::2012-11-29 15:11:11,425::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': < ResourceRef 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', isValid: 'True' obj: 'None'>, 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-667::DEBUG::2012-11-29 15:11:11,427::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-667::DEBUG::2012-11-29 15:11:11,429::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' >Thread-667::DEBUG::2012-11-29 15:11:11,431::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (0 active users) >Thread-667::DEBUG::2012-11-29 15:11:11,432::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free, finding out if anyone is waiting for it. >Thread-667::DEBUG::2012-11-29 15:11:11,434::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', Clearing records. >Thread-667::DEBUG::2012-11-29 15:11:11,436::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-667::DEBUG::2012-11-29 15:11:11,437::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-667::DEBUG::2012-11-29 15:11:11,437::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-667::DEBUG::2012-11-29 15:11:11,438::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-667::DEBUG::2012-11-29 15:11:11,438::task::957::TaskManager.Task::(_decref) Task=`9c853075-69c4-413d-8c8b-7added2d6da3`::ref 0 aborting False >Thread-672::INFO::2012-11-29 15:11:11,441::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (id: 1) >Thread-672::DEBUG::2012-11-29 15:11:11,441::safelease::178::SANLock::(acquireHostId) Host id for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 successfully acquired (id: 1) >Thread-673::DEBUG::2012-11-29 15:11:11,508::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-673::DEBUG::2012-11-29 15:11:11,508::task::568::TaskManager.Task::(_updateState) Task=`bf3d9ae7-9a1e-41f0-b16d-d2e603633156`::moving from state init -> state preparing >Thread-673::INFO::2012-11-29 15:11:11,508::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-673::DEBUG::2012-11-29 15:11:11,509::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`ca443718-fb23-485b-86b0-5921bed14e8c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-673::DEBUG::2012-11-29 15:11:11,509::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-673::DEBUG::2012-11-29 15:11:11,509::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-673::DEBUG::2012-11-29 15:11:11,509::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`ca443718-fb23-485b-86b0-5921bed14e8c`::Granted request >Thread-673::DEBUG::2012-11-29 15:11:11,510::task::794::TaskManager.Task::(resourceAcquired) Task=`bf3d9ae7-9a1e-41f0-b16d-d2e603633156`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-673::DEBUG::2012-11-29 15:11:11,510::task::957::TaskManager.Task::(_decref) Task=`bf3d9ae7-9a1e-41f0-b16d-d2e603633156`::ref 1 aborting False >Thread-673::INFO::2012-11-29 15:11:11,510::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-673::DEBUG::2012-11-29 15:11:11,513::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=333c691f1ce6b2be7e1ace1fb553179a8a155939'] >Thread-673::DEBUG::2012-11-29 15:11:11,514::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,514::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,514::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,514::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,515::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,515::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,515::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,516::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-673::DEBUG::2012-11-29 15:11:11,667::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-673::WARNING::2012-11-29 15:11:11,667::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-673::DEBUG::2012-11-29 15:11:11,668::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,678::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-673::DEBUG::2012-11-29 15:11:11,678::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-673::DEBUG::2012-11-29 15:11:11,681::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=333c691f1ce6b2be7e1ace1fb553179a8a155939'] >Thread-673::DEBUG::2012-11-29 15:11:11,682::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-673::WARNING::2012-11-29 15:11:11,682::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-673::WARNING::2012-11-29 15:11:11,683::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-673::DEBUG::2012-11-29 15:11:11,683::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-673::DEBUG::2012-11-29 15:11:11,683::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-673::DEBUG::2012-11-29 15:11:11,683::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-673::DEBUG::2012-11-29 15:11:11,684::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-673::WARNING::2012-11-29 15:11:11,684::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-673::DEBUG::2012-11-29 15:11:11,684::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-673::DEBUG::2012-11-29 15:11:11,685::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-673::DEBUG::2012-11-29 15:11:11,836::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-673::WARNING::2012-11-29 15:11:11,837::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found', ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-673::DEBUG::2012-11-29 15:11:11,838::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-673::INFO::2012-11-29 15:11:11,844::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-673::INFO::2012-11-29 15:11:11,844::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-673::INFO::2012-11-29 15:11:11,845::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-673::INFO::2012-11-29 15:11:11,845::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-673::INFO::2012-11-29 15:11:11,845::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-673::DEBUG::2012-11-29 15:11:11,846::task::1151::TaskManager.Task::(prepare) Task=`bf3d9ae7-9a1e-41f0-b16d-d2e603633156`::finished: None >Thread-673::DEBUG::2012-11-29 15:11:11,846::task::568::TaskManager.Task::(_updateState) Task=`bf3d9ae7-9a1e-41f0-b16d-d2e603633156`::moving from state preparing -> state finished >Thread-673::DEBUG::2012-11-29 15:11:11,846::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-673::DEBUG::2012-11-29 15:11:11,846::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-673::DEBUG::2012-11-29 15:11:11,846::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-673::DEBUG::2012-11-29 15:11:11,847::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-673::DEBUG::2012-11-29 15:11:11,847::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-673::DEBUG::2012-11-29 15:11:11,847::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-673::DEBUG::2012-11-29 15:11:11,847::task::957::TaskManager.Task::(_decref) Task=`bf3d9ae7-9a1e-41f0-b16d-d2e603633156`::ref 0 aborting False >Thread-681::DEBUG::2012-11-29 15:11:12,968::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-681::DEBUG::2012-11-29 15:11:12,968::task::568::TaskManager.Task::(_updateState) Task=`c6559059-c88a-4cba-9a93-61ff8b69a351`::moving from state init -> state preparing >Thread-681::INFO::2012-11-29 15:11:12,968::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-681::DEBUG::2012-11-29 15:11:12,969::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`0326397c-9ed2-4cb9-9ecc-21e8fbb17a6d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-681::DEBUG::2012-11-29 15:11:12,969::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-681::DEBUG::2012-11-29 15:11:12,969::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-681::DEBUG::2012-11-29 15:11:12,969::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`0326397c-9ed2-4cb9-9ecc-21e8fbb17a6d`::Granted request >Thread-681::DEBUG::2012-11-29 15:11:12,970::task::794::TaskManager.Task::(resourceAcquired) Task=`c6559059-c88a-4cba-9a93-61ff8b69a351`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-681::DEBUG::2012-11-29 15:11:12,970::task::957::TaskManager.Task::(_decref) Task=`c6559059-c88a-4cba-9a93-61ff8b69a351`::ref 1 aborting False >Thread-681::DEBUG::2012-11-29 15:11:12,970::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`4ec690e5-b6b4-4ea1-9b32-f62fb0f7ccc1`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-681::DEBUG::2012-11-29 15:11:12,970::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-681::DEBUG::2012-11-29 15:11:12,971::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-681::DEBUG::2012-11-29 15:11:12,971::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`4ec690e5-b6b4-4ea1-9b32-f62fb0f7ccc1`::Granted request >Thread-681::DEBUG::2012-11-29 15:11:12,971::task::794::TaskManager.Task::(resourceAcquired) Task=`c6559059-c88a-4cba-9a93-61ff8b69a351`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-681::DEBUG::2012-11-29 15:11:12,971::task::957::TaskManager.Task::(_decref) Task=`c6559059-c88a-4cba-9a93-61ff8b69a351`::ref 1 aborting False >Thread-681::INFO::2012-11-29 15:11:12,971::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-681::DEBUG::2012-11-29 15:11:12,972::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-681::DEBUG::2012-11-29 15:11:12,972::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-681::DEBUG::2012-11-29 15:11:13,123::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-681::WARNING::2012-11-29 15:11:13,124::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-681::DEBUG::2012-11-29 15:11:13,124::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-681::DEBUG::2012-11-29 15:11:13,132::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-681::DEBUG::2012-11-29 15:11:13,133::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-681::DEBUG::2012-11-29 15:11:13,136::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-681::DEBUG::2012-11-29 15:11:13,137::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-681::WARNING::2012-11-29 15:11:13,137::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_imageNS already registered >Thread-681::WARNING::2012-11-29 15:11:13,137::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS already registered >Thread-681::DEBUG::2012-11-29 15:11:13,140::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-681::DEBUG::2012-11-29 15:11:13,140::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-681::DEBUG::2012-11-29 15:11:13,140::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8126459fd7f4957b0047ddc803a6ad59b150194'] >Thread-681::DEBUG::2012-11-29 15:11:13,144::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-681::DEBUG::2012-11-29 15:11:13,144::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-681::DEBUG::2012-11-29 15:11:13,145::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-615::DEBUG::2012-11-29 15:11:13,145::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-681::DEBUG::2012-11-29 15:11:13,145::sp::1558::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` stopped monitoring domain `76a4921b-744d-4d18-9b01-f1754c79020d` >Thread-681::DEBUG::2012-11-29 15:11:13,146::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-681::INFO::2012-11-29 15:11:13,146::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-681::DEBUG::2012-11-29 15:11:13,146::task::1151::TaskManager.Task::(prepare) Task=`c6559059-c88a-4cba-9a93-61ff8b69a351`::finished: None >Thread-681::DEBUG::2012-11-29 15:11:13,146::task::568::TaskManager.Task::(_updateState) Task=`c6559059-c88a-4cba-9a93-61ff8b69a351`::moving from state preparing -> state finished >Thread-681::DEBUG::2012-11-29 15:11:13,146::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-681::DEBUG::2012-11-29 15:11:13,147::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-681::DEBUG::2012-11-29 15:11:13,147::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-681::DEBUG::2012-11-29 15:11:13,147::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-681::DEBUG::2012-11-29 15:11:13,147::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-681::DEBUG::2012-11-29 15:11:13,147::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-681::DEBUG::2012-11-29 15:11:13,148::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-681::DEBUG::2012-11-29 15:11:13,148::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-681::DEBUG::2012-11-29 15:11:13,148::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-681::DEBUG::2012-11-29 15:11:13,148::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-681::DEBUG::2012-11-29 15:11:13,149::task::957::TaskManager.Task::(_decref) Task=`c6559059-c88a-4cba-9a93-61ff8b69a351`::ref 0 aborting False >Thread-685::DEBUG::2012-11-29 15:11:13,205::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-685::DEBUG::2012-11-29 15:11:13,205::task::568::TaskManager.Task::(_updateState) Task=`72f87915-369b-43f9-8221-c827636c73a0`::moving from state init -> state preparing >Thread-685::INFO::2012-11-29 15:11:13,205::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-685::DEBUG::2012-11-29 15:11:13,206::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`7c472491-168f-4b48-a7fb-b9527b8d30f2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-685::DEBUG::2012-11-29 15:11:13,206::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-685::DEBUG::2012-11-29 15:11:13,206::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-685::DEBUG::2012-11-29 15:11:13,206::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`7c472491-168f-4b48-a7fb-b9527b8d30f2`::Granted request >Thread-685::DEBUG::2012-11-29 15:11:13,207::task::794::TaskManager.Task::(resourceAcquired) Task=`72f87915-369b-43f9-8221-c827636c73a0`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-685::DEBUG::2012-11-29 15:11:13,207::task::957::TaskManager.Task::(_decref) Task=`72f87915-369b-43f9-8221-c827636c73a0`::ref 1 aborting False >Thread-685::INFO::2012-11-29 15:11:13,207::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-685::DEBUG::2012-11-29 15:11:13,210::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8126459fd7f4957b0047ddc803a6ad59b150194'] >Thread-685::DEBUG::2012-11-29 15:11:13,211::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,211::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,211::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,212::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,212::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,212::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,212::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,213::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-685::DEBUG::2012-11-29 15:11:13,366::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-685::WARNING::2012-11-29 15:11:13,367::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-685::DEBUG::2012-11-29 15:11:13,367::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,376::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-685::DEBUG::2012-11-29 15:11:13,376::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-685::DEBUG::2012-11-29 15:11:13,379::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8126459fd7f4957b0047ddc803a6ad59b150194'] >Thread-685::DEBUG::2012-11-29 15:11:13,381::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-685::WARNING::2012-11-29 15:11:13,381::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-685::WARNING::2012-11-29 15:11:13,382::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-685::DEBUG::2012-11-29 15:11:13,382::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-685::DEBUG::2012-11-29 15:11:13,382::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-685::DEBUG::2012-11-29 15:11:13,383::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-685::DEBUG::2012-11-29 15:11:13,383::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-685::WARNING::2012-11-29 15:11:13,383::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-685::DEBUG::2012-11-29 15:11:13,384::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-685::DEBUG::2012-11-29 15:11:13,384::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-685::DEBUG::2012-11-29 15:11:13,535::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-685::WARNING::2012-11-29 15:11:13,536::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-685::DEBUG::2012-11-29 15:11:13,536::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-685::INFO::2012-11-29 15:11:13,542::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-685::INFO::2012-11-29 15:11:13,542::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-685::INFO::2012-11-29 15:11:13,543::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-685::INFO::2012-11-29 15:11:13,543::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-685::DEBUG::2012-11-29 15:11:13,543::task::1151::TaskManager.Task::(prepare) Task=`72f87915-369b-43f9-8221-c827636c73a0`::finished: None >Thread-685::DEBUG::2012-11-29 15:11:13,543::task::568::TaskManager.Task::(_updateState) Task=`72f87915-369b-43f9-8221-c827636c73a0`::moving from state preparing -> state finished >Thread-685::DEBUG::2012-11-29 15:11:13,544::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-685::DEBUG::2012-11-29 15:11:13,544::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-685::DEBUG::2012-11-29 15:11:13,544::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-685::DEBUG::2012-11-29 15:11:13,544::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-685::DEBUG::2012-11-29 15:11:13,545::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-685::DEBUG::2012-11-29 15:11:13,545::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-685::DEBUG::2012-11-29 15:11:13,545::task::957::TaskManager.Task::(_decref) Task=`72f87915-369b-43f9-8221-c827636c73a0`::ref 0 aborting False >Thread-692::DEBUG::2012-11-29 15:11:13,577::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-692::DEBUG::2012-11-29 15:11:13,577::task::568::TaskManager.Task::(_updateState) Task=`f485245f-9e20-45f8-a5ae-838c72974e3c`::moving from state init -> state preparing >Thread-692::INFO::2012-11-29 15:11:13,578::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a', 'port': ''}], options=None) >Thread-692::DEBUG::2012-11-29 15:11:13,578::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-692::DEBUG::2012-11-29 15:11:13,607::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-692::DEBUG::2012-11-29 15:11:13,607::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-692::DEBUG::2012-11-29 15:11:13,607::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-692::DEBUG::2012-11-29 15:11:13,607::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-692::DEBUG::2012-11-29 15:11:13,608::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-692::DEBUG::2012-11-29 15:11:13,621::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-692::DEBUG::2012-11-29 15:11:13,622::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-692::DEBUG::2012-11-29 15:11:13,623::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-692::DEBUG::2012-11-29 15:11:13,626::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-692::DEBUG::2012-11-29 15:11:13,628::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-692::DEBUG::2012-11-29 15:11:13,630::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-692::DEBUG::2012-11-29 15:11:13,632::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-692::DEBUG::2012-11-29 15:11:13,634::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-692::DEBUG::2012-11-29 15:11:13,636::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-692::DEBUG::2012-11-29 15:11:13,638::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-692::DEBUG::2012-11-29 15:11:15,641::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-692::DEBUG::2012-11-29 15:11:15,683::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-692::DEBUG::2012-11-29 15:11:15,683::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-692::DEBUG::2012-11-29 15:11:15,684::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-692::DEBUG::2012-11-29 15:11:15,684::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-692::DEBUG::2012-11-29 15:11:15,684::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-692::DEBUG::2012-11-29 15:11:15,684::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-692::DEBUG::2012-11-29 15:11:15,685::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-692::DEBUG::2012-11-29 15:11:15,685::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-692::INFO::2012-11-29 15:11:15,685::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-692::DEBUG::2012-11-29 15:11:15,685::task::1151::TaskManager.Task::(prepare) Task=`f485245f-9e20-45f8-a5ae-838c72974e3c`::finished: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-692::DEBUG::2012-11-29 15:11:15,686::task::568::TaskManager.Task::(_updateState) Task=`f485245f-9e20-45f8-a5ae-838c72974e3c`::moving from state preparing -> state finished >Thread-692::DEBUG::2012-11-29 15:11:15,686::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-692::DEBUG::2012-11-29 15:11:15,686::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-692::DEBUG::2012-11-29 15:11:15,686::task::957::TaskManager.Task::(_decref) Task=`f485245f-9e20-45f8-a5ae-838c72974e3c`::ref 0 aborting False >Thread-694::DEBUG::2012-11-29 15:11:16,682::task::568::TaskManager.Task::(_updateState) Task=`ad4695f8-48df-45bc-a76c-88b3627d7416`::moving from state init -> state preparing >Thread-694::INFO::2012-11-29 15:11:16,682::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-694::INFO::2012-11-29 15:11:16,682::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00217509269714', 'lastCheck': '3.0', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00323486328125', 'lastCheck': '5.2', 'code': 0, 'valid': True}} >Thread-694::DEBUG::2012-11-29 15:11:16,683::task::1151::TaskManager.Task::(prepare) Task=`ad4695f8-48df-45bc-a76c-88b3627d7416`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00217509269714', 'lastCheck': '3.0', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00323486328125', 'lastCheck': '5.2', 'code': 0, 'valid': True}} >Thread-694::DEBUG::2012-11-29 15:11:16,683::task::568::TaskManager.Task::(_updateState) Task=`ad4695f8-48df-45bc-a76c-88b3627d7416`::moving from state preparing -> state finished >Thread-694::DEBUG::2012-11-29 15:11:16,683::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-694::DEBUG::2012-11-29 15:11:16,683::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-694::DEBUG::2012-11-29 15:11:16,683::task::957::TaskManager.Task::(_decref) Task=`ad4695f8-48df-45bc-a76c-88b3627d7416`::ref 0 aborting False >Thread-696::DEBUG::2012-11-29 15:11:16,808::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-696::DEBUG::2012-11-29 15:11:16,808::task::568::TaskManager.Task::(_updateState) Task=`d8fcc604-1c0e-4895-ac24-ad04fb00cb2a`::moving from state init -> state preparing >Thread-696::INFO::2012-11-29 15:11:16,808::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a', 'port': ''}], options=None) >Thread-696::INFO::2012-11-29 15:11:16,808::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-696::DEBUG::2012-11-29 15:11:16,809::task::1151::TaskManager.Task::(prepare) Task=`d8fcc604-1c0e-4895-ac24-ad04fb00cb2a`::finished: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-696::DEBUG::2012-11-29 15:11:16,809::task::568::TaskManager.Task::(_updateState) Task=`d8fcc604-1c0e-4895-ac24-ad04fb00cb2a`::moving from state preparing -> state finished >Thread-696::DEBUG::2012-11-29 15:11:16,809::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-696::DEBUG::2012-11-29 15:11:16,809::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-696::DEBUG::2012-11-29 15:11:16,809::task::957::TaskManager.Task::(_decref) Task=`d8fcc604-1c0e-4895-ac24-ad04fb00cb2a`::ref 0 aborting False >Thread-697::DEBUG::2012-11-29 15:11:16,837::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-697::DEBUG::2012-11-29 15:11:16,837::task::568::TaskManager.Task::(_updateState) Task=`79a365c6-2c38-4da0-8392-67c71346038c`::moving from state init -> state preparing >Thread-697::INFO::2012-11-29 15:11:16,837::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a', 'port': ''}], options=None) >Thread-697::DEBUG::2012-11-29 15:11:16,840::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-697::INFO::2012-11-29 15:11:16,869::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-697::DEBUG::2012-11-29 15:11:16,870::task::1151::TaskManager.Task::(prepare) Task=`79a365c6-2c38-4da0-8392-67c71346038c`::finished: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-697::DEBUG::2012-11-29 15:11:16,870::task::568::TaskManager.Task::(_updateState) Task=`79a365c6-2c38-4da0-8392-67c71346038c`::moving from state preparing -> state finished >Thread-697::DEBUG::2012-11-29 15:11:16,870::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-697::DEBUG::2012-11-29 15:11:16,870::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-697::DEBUG::2012-11-29 15:11:16,871::task::957::TaskManager.Task::(_decref) Task=`79a365c6-2c38-4da0-8392-67c71346038c`::ref 0 aborting False >Thread-698::DEBUG::2012-11-29 15:11:16,898::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-698::DEBUG::2012-11-29 15:11:16,899::task::568::TaskManager.Task::(_updateState) Task=`e7e6fc6a-2e77-401f-b9c9-18d810fd20dd`::moving from state init -> state preparing >Thread-698::INFO::2012-11-29 15:11:16,899::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-698::DEBUG::2012-11-29 15:11:16,900::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`886eee1d-0eb7-460c-9176-16626ab9db47`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-698::DEBUG::2012-11-29 15:11:16,900::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-698::DEBUG::2012-11-29 15:11:16,900::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-698::DEBUG::2012-11-29 15:11:16,900::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`886eee1d-0eb7-460c-9176-16626ab9db47`::Granted request >Thread-698::DEBUG::2012-11-29 15:11:16,901::task::794::TaskManager.Task::(resourceAcquired) Task=`e7e6fc6a-2e77-401f-b9c9-18d810fd20dd`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-698::DEBUG::2012-11-29 15:11:16,901::task::957::TaskManager.Task::(_decref) Task=`e7e6fc6a-2e77-401f-b9c9-18d810fd20dd`::ref 1 aborting False >Thread-698::DEBUG::2012-11-29 15:11:16,901::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`d9bd8c1c-e5d7-492f-8213-95a5fd97371f`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-698::DEBUG::2012-11-29 15:11:16,901::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-698::DEBUG::2012-11-29 15:11:16,902::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-698::DEBUG::2012-11-29 15:11:16,902::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`d9bd8c1c-e5d7-492f-8213-95a5fd97371f`::Granted request >Thread-698::DEBUG::2012-11-29 15:11:16,902::task::794::TaskManager.Task::(resourceAcquired) Task=`e7e6fc6a-2e77-401f-b9c9-18d810fd20dd`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-698::DEBUG::2012-11-29 15:11:16,902::task::957::TaskManager.Task::(_decref) Task=`e7e6fc6a-2e77-401f-b9c9-18d810fd20dd`::ref 1 aborting False >Thread-698::INFO::2012-11-29 15:11:16,903::sp::984::Storage.StoragePool::(detachSD) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-698::DEBUG::2012-11-29 15:11:16,903::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-698::DEBUG::2012-11-29 15:11:16,903::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-698::DEBUG::2012-11-29 15:11:16,903::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-698::DEBUG::2012-11-29 15:11:16,903::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-698::DEBUG::2012-11-29 15:11:16,904::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-698::DEBUG::2012-11-29 15:11:16,917::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-698::DEBUG::2012-11-29 15:11:16,917::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-698::DEBUG::2012-11-29 15:11:16,919::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-698::DEBUG::2012-11-29 15:11:16,921::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-698::DEBUG::2012-11-29 15:11:16,923::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-698::DEBUG::2012-11-29 15:11:16,925::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-698::DEBUG::2012-11-29 15:11:16,928::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-698::DEBUG::2012-11-29 15:11:16,929::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-698::DEBUG::2012-11-29 15:11:16,932::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-698::DEBUG::2012-11-29 15:11:16,933::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-698::DEBUG::2012-11-29 15:11:18,937::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-698::DEBUG::2012-11-29 15:11:18,984::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-698::DEBUG::2012-11-29 15:11:18,985::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-698::DEBUG::2012-11-29 15:11:18,985::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-698::DEBUG::2012-11-29 15:11:18,986::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-698::DEBUG::2012-11-29 15:11:18,986::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-698::DEBUG::2012-11-29 15:11:18,986::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-698::DEBUG::2012-11-29 15:11:18,986::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-698::DEBUG::2012-11-29 15:11:18,987::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-698::DEBUG::2012-11-29 15:11:18,987::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-698::DEBUG::2012-11-29 15:11:18,988::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-698::DEBUG::2012-11-29 15:11:19,142::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-698::WARNING::2012-11-29 15:11:19,143::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-698::DEBUG::2012-11-29 15:11:19,143::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-698::DEBUG::2012-11-29 15:11:19,152::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-698::DEBUG::2012-11-29 15:11:19,152::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-698::DEBUG::2012-11-29 15:11:19,155::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-698::DEBUG::2012-11-29 15:11:19,157::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-698::WARNING::2012-11-29 15:11:19,157::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_imageNS already registered >Thread-698::WARNING::2012-11-29 15:11:19,158::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS already registered >Thread-698::DEBUG::2012-11-29 15:11:19,160::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-698::DEBUG::2012-11-29 15:11:19,160::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-698::DEBUG::2012-11-29 15:11:19,161::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-698::DEBUG::2012-11-29 15:11:19,161::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-698::DEBUG::2012-11-29 15:11:19,161::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-698::DEBUG::2012-11-29 15:11:19,161::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-698::DEBUG::2012-11-29 15:11:19,165::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-698::WARNING::2012-11-29 15:11:19,165::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `76a4921b-744d-4d18-9b01-f1754c79020d` >Thread-698::DEBUG::2012-11-29 15:11:19,165::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-698::DEBUG::2012-11-29 15:11:19,166::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-698::DEBUG::2012-11-29 15:11:19,166::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8234598d7c23196263549de1a563f326a01a53a3'] >Thread-698::DEBUG::2012-11-29 15:11:19,169::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-698::DEBUG::2012-11-29 15:11:19,170::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-698::DEBUG::2012-11-29 15:11:19,170::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-698::DEBUG::2012-11-29 15:11:19,170::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-698::DEBUG::2012-11-29 15:11:19,170::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `76a4921b-744d-4d18-9b01-f1754c79020d` is done >Thread-698::INFO::2012-11-29 15:11:19,170::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-698::DEBUG::2012-11-29 15:11:19,171::task::1151::TaskManager.Task::(prepare) Task=`e7e6fc6a-2e77-401f-b9c9-18d810fd20dd`::finished: None >Thread-698::DEBUG::2012-11-29 15:11:19,171::task::568::TaskManager.Task::(_updateState) Task=`e7e6fc6a-2e77-401f-b9c9-18d810fd20dd`::moving from state preparing -> state finished >Thread-698::DEBUG::2012-11-29 15:11:19,171::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-698::DEBUG::2012-11-29 15:11:19,171::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-698::DEBUG::2012-11-29 15:11:19,171::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-698::DEBUG::2012-11-29 15:11:19,172::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-698::DEBUG::2012-11-29 15:11:19,172::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-698::DEBUG::2012-11-29 15:11:19,172::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-698::DEBUG::2012-11-29 15:11:19,172::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-698::DEBUG::2012-11-29 15:11:19,173::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-698::DEBUG::2012-11-29 15:11:19,173::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-698::DEBUG::2012-11-29 15:11:19,173::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-698::DEBUG::2012-11-29 15:11:19,173::task::957::TaskManager.Task::(_decref) Task=`e7e6fc6a-2e77-401f-b9c9-18d810fd20dd`::ref 0 aborting False >Thread-703::DEBUG::2012-11-29 15:11:19,202::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-703::DEBUG::2012-11-29 15:11:19,202::task::568::TaskManager.Task::(_updateState) Task=`8b64e92c-7399-4f4c-b9f2-8c84098039bc`::moving from state init -> state preparing >Thread-703::INFO::2012-11-29 15:11:19,202::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-703::INFO::2012-11-29 15:11:19,203::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-703::DEBUG::2012-11-29 15:11:19,203::task::1151::TaskManager.Task::(prepare) Task=`8b64e92c-7399-4f4c-b9f2-8c84098039bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-703::DEBUG::2012-11-29 15:11:19,203::task::568::TaskManager.Task::(_updateState) Task=`8b64e92c-7399-4f4c-b9f2-8c84098039bc`::moving from state preparing -> state finished >Thread-703::DEBUG::2012-11-29 15:11:19,203::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-703::DEBUG::2012-11-29 15:11:19,203::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-703::DEBUG::2012-11-29 15:11:19,203::task::957::TaskManager.Task::(_decref) Task=`8b64e92c-7399-4f4c-b9f2-8c84098039bc`::ref 0 aborting False >Thread-704::DEBUG::2012-11-29 15:11:19,232::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-704::DEBUG::2012-11-29 15:11:19,232::task::568::TaskManager.Task::(_updateState) Task=`36904a67-3bfc-401c-bf07-e55b86ee7283`::moving from state init -> state preparing >Thread-704::INFO::2012-11-29 15:11:19,232::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-704::DEBUG::2012-11-29 15:11:19,233::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`b48d12fd-3322-4781-af65-98c0daa15bf4`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-704::DEBUG::2012-11-29 15:11:19,233::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-704::DEBUG::2012-11-29 15:11:19,233::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-704::DEBUG::2012-11-29 15:11:19,233::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`b48d12fd-3322-4781-af65-98c0daa15bf4`::Granted request >Thread-704::DEBUG::2012-11-29 15:11:19,234::task::794::TaskManager.Task::(resourceAcquired) Task=`36904a67-3bfc-401c-bf07-e55b86ee7283`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-704::DEBUG::2012-11-29 15:11:19,234::task::957::TaskManager.Task::(_decref) Task=`36904a67-3bfc-401c-bf07-e55b86ee7283`::ref 1 aborting False >Thread-704::INFO::2012-11-29 15:11:19,234::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-704::DEBUG::2012-11-29 15:11:19,237::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8234598d7c23196263549de1a563f326a01a53a3'] >Thread-704::DEBUG::2012-11-29 15:11:19,238::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-704::DEBUG::2012-11-29 15:11:19,238::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-704::DEBUG::2012-11-29 15:11:19,238::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-704::DEBUG::2012-11-29 15:11:19,240::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-705::DEBUG::2012-11-29 15:11:19,241::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-705::DEBUG::2012-11-29 15:11:19,243::task::568::TaskManager.Task::(_updateState) Task=`92a7eae2-fa43-4865-9177-4ebec6e68537`::moving from state init -> state preparing >Thread-704::DEBUG::2012-11-29 15:11:19,243::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-705::INFO::2012-11-29 15:11:19,245::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-704::DEBUG::2012-11-29 15:11:19,246::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-705::DEBUG::2012-11-29 15:11:19,248::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`b3837c58-3244-42fd-8e78-eb0b001fd391`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-704::DEBUG::2012-11-29 15:11:19,249::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-705::DEBUG::2012-11-29 15:11:19,249::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-705::DEBUG::2012-11-29 15:11:19,251::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-705::DEBUG::2012-11-29 15:11:19,254::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`b3837c58-3244-42fd-8e78-eb0b001fd391`::Granted request >Thread-704::DEBUG::2012-11-29 15:11:19,254::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-705::DEBUG::2012-11-29 15:11:19,262::task::794::TaskManager.Task::(resourceAcquired) Task=`92a7eae2-fa43-4865-9177-4ebec6e68537`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-705::DEBUG::2012-11-29 15:11:19,262::task::957::TaskManager.Task::(_decref) Task=`92a7eae2-fa43-4865-9177-4ebec6e68537`::ref 1 aborting False >Thread-704::DEBUG::2012-11-29 15:11:19,406::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-704::WARNING::2012-11-29 15:11:19,406::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-704::DEBUG::2012-11-29 15:11:19,407::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-704::DEBUG::2012-11-29 15:11:19,416::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-704::DEBUG::2012-11-29 15:11:19,416::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-704::DEBUG::2012-11-29 15:11:19,419::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8234598d7c23196263549de1a563f326a01a53a3'] >Thread-704::DEBUG::2012-11-29 15:11:19,420::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-704::WARNING::2012-11-29 15:11:19,420::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-704::WARNING::2012-11-29 15:11:19,420::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-704::DEBUG::2012-11-29 15:11:19,422::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-704::DEBUG::2012-11-29 15:11:19,422::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-704::DEBUG::2012-11-29 15:11:19,424::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-704::DEBUG::2012-11-29 15:11:19,426::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-704::WARNING::2012-11-29 15:11:19,427::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-704::DEBUG::2012-11-29 15:11:19,431::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-704::DEBUG::2012-11-29 15:11:19,436::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-705::DEBUG::2012-11-29 15:11:19,437::lvm::368::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-705::DEBUG::2012-11-29 15:11:19,444::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-704::DEBUG::2012-11-29 15:11:19,592::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-704::WARNING::2012-11-29 15:11:19,593::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-704::INFO::2012-11-29 15:11:19,600::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-705::DEBUG::2012-11-29 15:11:19,601::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-704::INFO::2012-11-29 15:11:19,602::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-705::WARNING::2012-11-29 15:11:19,603::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-704::INFO::2012-11-29 15:11:19,604::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-705::DEBUG::2012-11-29 15:11:19,604::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-704::INFO::2012-11-29 15:11:19,605::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-704::DEBUG::2012-11-29 15:11:19,606::task::1151::TaskManager.Task::(prepare) Task=`36904a67-3bfc-401c-bf07-e55b86ee7283`::finished: None >Thread-704::DEBUG::2012-11-29 15:11:19,607::task::568::TaskManager.Task::(_updateState) Task=`36904a67-3bfc-401c-bf07-e55b86ee7283`::moving from state preparing -> state finished >Thread-704::DEBUG::2012-11-29 15:11:19,609::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-704::DEBUG::2012-11-29 15:11:19,612::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-704::DEBUG::2012-11-29 15:11:19,616::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-704::DEBUG::2012-11-29 15:11:19,618::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (1 active users) >Thread-704::DEBUG::2012-11-29 15:11:19,621::task::957::TaskManager.Task::(_decref) Task=`36904a67-3bfc-401c-bf07-e55b86ee7283`::ref 0 aborting False >Thread-705::DEBUG::2012-11-29 15:11:19,626::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-705::DEBUG::2012-11-29 15:11:19,626::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-705::DEBUG::2012-11-29 15:11:19,629::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9b0b5035d83a6ecb376ae2792c24d6f80f9f8e83'] >Thread-705::DEBUG::2012-11-29 15:11:19,630::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-705::WARNING::2012-11-29 15:11:19,630::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_imageNS already registered >Thread-705::WARNING::2012-11-29 15:11:19,631::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_volumeNS already registered >Thread-705::INFO::2012-11-29 15:11:19,631::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}}} >Thread-705::DEBUG::2012-11-29 15:11:19,631::task::1151::TaskManager.Task::(prepare) Task=`92a7eae2-fa43-4865-9177-4ebec6e68537`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}}} >Thread-705::DEBUG::2012-11-29 15:11:19,631::task::568::TaskManager.Task::(_updateState) Task=`92a7eae2-fa43-4865-9177-4ebec6e68537`::moving from state preparing -> state finished >Thread-705::DEBUG::2012-11-29 15:11:19,631::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-705::DEBUG::2012-11-29 15:11:19,632::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-705::DEBUG::2012-11-29 15:11:19,632::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-705::DEBUG::2012-11-29 15:11:19,632::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-705::DEBUG::2012-11-29 15:11:19,632::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-705::DEBUG::2012-11-29 15:11:19,633::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-705::DEBUG::2012-11-29 15:11:19,633::task::957::TaskManager.Task::(_decref) Task=`92a7eae2-fa43-4865-9177-4ebec6e68537`::ref 0 aborting False >Thread-715::DEBUG::2012-11-29 15:11:19,658::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-715::DEBUG::2012-11-29 15:11:19,658::task::568::TaskManager.Task::(_updateState) Task=`c20c9629-1e76-4b6d-810e-d4c89cb78ef9`::moving from state init -> state preparing >Thread-715::INFO::2012-11-29 15:11:19,658::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a', 'port': ''}], options=None) >Thread-715::DEBUG::2012-11-29 15:11:19,659::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-715::DEBUG::2012-11-29 15:11:19,688::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-715::DEBUG::2012-11-29 15:11:19,688::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-715::DEBUG::2012-11-29 15:11:19,688::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-715::DEBUG::2012-11-29 15:11:19,689::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-715::DEBUG::2012-11-29 15:11:19,689::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-715::DEBUG::2012-11-29 15:11:19,703::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-715::DEBUG::2012-11-29 15:11:19,703::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-715::DEBUG::2012-11-29 15:11:19,705::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-715::DEBUG::2012-11-29 15:11:19,707::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-715::DEBUG::2012-11-29 15:11:19,709::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-715::DEBUG::2012-11-29 15:11:19,711::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-715::DEBUG::2012-11-29 15:11:19,713::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-715::DEBUG::2012-11-29 15:11:19,715::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-715::DEBUG::2012-11-29 15:11:19,718::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-715::DEBUG::2012-11-29 15:11:19,720::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-715::DEBUG::2012-11-29 15:11:21,723::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-715::DEBUG::2012-11-29 15:11:21,776::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-715::DEBUG::2012-11-29 15:11:21,777::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-715::DEBUG::2012-11-29 15:11:21,777::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-715::DEBUG::2012-11-29 15:11:21,778::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-715::DEBUG::2012-11-29 15:11:21,778::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-715::DEBUG::2012-11-29 15:11:21,778::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-715::DEBUG::2012-11-29 15:11:21,779::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-715::DEBUG::2012-11-29 15:11:21,779::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-715::INFO::2012-11-29 15:11:21,779::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-715::DEBUG::2012-11-29 15:11:21,779::task::1151::TaskManager.Task::(prepare) Task=`c20c9629-1e76-4b6d-810e-d4c89cb78ef9`::finished: {'statuslist': [{'status': 0, 'id': 'd97c1fc2-9cbd-42f4-aa06-4e5e62c41d6a'}]} >Thread-715::DEBUG::2012-11-29 15:11:21,780::task::568::TaskManager.Task::(_updateState) Task=`c20c9629-1e76-4b6d-810e-d4c89cb78ef9`::moving from state preparing -> state finished >Thread-715::DEBUG::2012-11-29 15:11:21,780::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-715::DEBUG::2012-11-29 15:11:21,780::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-715::DEBUG::2012-11-29 15:11:21,781::task::957::TaskManager.Task::(_decref) Task=`c20c9629-1e76-4b6d-810e-d4c89cb78ef9`::ref 0 aborting False >Thread-718::DEBUG::2012-11-29 15:11:23,124::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-718::DEBUG::2012-11-29 15:11:23,124::task::568::TaskManager.Task::(_updateState) Task=`b453c93e-4bcb-4065-8bdc-a4f143ad9321`::moving from state init -> state preparing >Thread-718::INFO::2012-11-29 15:11:23,124::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-718::INFO::2012-11-29 15:11:23,125::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-718::DEBUG::2012-11-29 15:11:23,125::task::1151::TaskManager.Task::(prepare) Task=`b453c93e-4bcb-4065-8bdc-a4f143ad9321`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-718::DEBUG::2012-11-29 15:11:23,125::task::568::TaskManager.Task::(_updateState) Task=`b453c93e-4bcb-4065-8bdc-a4f143ad9321`::moving from state preparing -> state finished >Thread-718::DEBUG::2012-11-29 15:11:23,125::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-718::DEBUG::2012-11-29 15:11:23,125::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-718::DEBUG::2012-11-29 15:11:23,126::task::957::TaskManager.Task::(_decref) Task=`b453c93e-4bcb-4065-8bdc-a4f143ad9321`::ref 0 aborting False >Thread-719::DEBUG::2012-11-29 15:11:23,161::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-719::DEBUG::2012-11-29 15:11:23,162::task::568::TaskManager.Task::(_updateState) Task=`7c8c2ce6-98eb-4aa6-87c4-499deb4d07e7`::moving from state init -> state preparing >Thread-719::INFO::2012-11-29 15:11:23,162::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-719::DEBUG::2012-11-29 15:11:23,165::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-719::INFO::2012-11-29 15:11:23,189::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-719::DEBUG::2012-11-29 15:11:23,190::task::1151::TaskManager.Task::(prepare) Task=`7c8c2ce6-98eb-4aa6-87c4-499deb4d07e7`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-719::DEBUG::2012-11-29 15:11:23,190::task::568::TaskManager.Task::(_updateState) Task=`7c8c2ce6-98eb-4aa6-87c4-499deb4d07e7`::moving from state preparing -> state finished >Thread-719::DEBUG::2012-11-29 15:11:23,190::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-719::DEBUG::2012-11-29 15:11:23,190::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-719::DEBUG::2012-11-29 15:11:23,190::task::957::TaskManager.Task::(_decref) Task=`7c8c2ce6-98eb-4aa6-87c4-499deb4d07e7`::ref 0 aborting False >Thread-720::DEBUG::2012-11-29 15:11:23,227::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-720::DEBUG::2012-11-29 15:11:23,228::task::568::TaskManager.Task::(_updateState) Task=`299c0306-4508-40ed-9fa4-c6fd4d90ae90`::moving from state init -> state preparing >Thread-720::INFO::2012-11-29 15:11:23,228::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=3, storageType=1, remotePath='10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', options=None) >Thread-720::DEBUG::2012-11-29 15:11:23,228::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-720::DEBUG::2012-11-29 15:11:23,228::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-720::DEBUG::2012-11-29 15:11:23,228::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-720::DEBUG::2012-11-29 15:11:23,229::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-720::DEBUG::2012-11-29 15:11:23,229::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-720::DEBUG::2012-11-29 15:11:23,242::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-720::DEBUG::2012-11-29 15:11:23,242::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-720::DEBUG::2012-11-29 15:11:23,244::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-720::DEBUG::2012-11-29 15:11:23,246::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-720::DEBUG::2012-11-29 15:11:23,249::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-720::DEBUG::2012-11-29 15:11:23,251::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-720::DEBUG::2012-11-29 15:11:23,253::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-720::DEBUG::2012-11-29 15:11:23,255::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-720::DEBUG::2012-11-29 15:11:23,257::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-720::DEBUG::2012-11-29 15:11:23,259::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-720::DEBUG::2012-11-29 15:11:25,262::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-720::DEBUG::2012-11-29 15:11:25,308::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-720::DEBUG::2012-11-29 15:11:25,309::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,309::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,309::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,310::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,310::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,310::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,311::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-720::DEBUG::2012-11-29 15:11:25,311::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,312::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-720::DEBUG::2012-11-29 15:11:25,458::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-720::DEBUG::2012-11-29 15:11:25,458::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,465::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,465::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-720::DEBUG::2012-11-29 15:11:25,618::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-720::WARNING::2012-11-29 15:11:25,618::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-720::DEBUG::2012-11-29 15:11:25,619::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-720::DEBUG::2012-11-29 15:11:25,627::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-720::DEBUG::2012-11-29 15:11:25,627::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-720::DEBUG::2012-11-29 15:11:25,631::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-720::DEBUG::2012-11-29 15:11:25,633::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-720::WARNING::2012-11-29 15:11:25,633::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_imageNS already registered >Thread-720::WARNING::2012-11-29 15:11:25,633::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS already registered >Thread-720::INFO::2012-11-29 15:11:25,633::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': ['76a4921b-744d-4d18-9b01-f1754c79020d']} >Thread-720::DEBUG::2012-11-29 15:11:25,634::task::1151::TaskManager.Task::(prepare) Task=`299c0306-4508-40ed-9fa4-c6fd4d90ae90`::finished: {'domlist': ['76a4921b-744d-4d18-9b01-f1754c79020d']} >Thread-720::DEBUG::2012-11-29 15:11:25,634::task::568::TaskManager.Task::(_updateState) Task=`299c0306-4508-40ed-9fa4-c6fd4d90ae90`::moving from state preparing -> state finished >Thread-720::DEBUG::2012-11-29 15:11:25,634::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720::DEBUG::2012-11-29 15:11:25,634::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720::DEBUG::2012-11-29 15:11:25,634::task::957::TaskManager.Task::(_decref) Task=`299c0306-4508-40ed-9fa4-c6fd4d90ae90`::ref 0 aborting False >Thread-728::DEBUG::2012-11-29 15:11:25,717::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-728::DEBUG::2012-11-29 15:11:25,717::task::568::TaskManager.Task::(_updateState) Task=`f199110d-6311-4fbd-a270-2d489b73c903`::moving from state init -> state preparing >Thread-728::INFO::2012-11-29 15:11:25,717::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', options=None) >Thread-728::INFO::2012-11-29 15:11:25,718::fileSD::302::Storage.StorageDomain::(validate) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d >Thread-728::DEBUG::2012-11-29 15:11:25,720::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-728::DEBUG::2012-11-29 15:11:25,721::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`86964e48-c110-4db6-bb51-07c50a643378`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-728::DEBUG::2012-11-29 15:11:25,721::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'shared' >Thread-728::DEBUG::2012-11-29 15:11:25,722::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'shared' (1 active user) >Thread-728::DEBUG::2012-11-29 15:11:25,722::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`86964e48-c110-4db6-bb51-07c50a643378`::Granted request >Thread-728::DEBUG::2012-11-29 15:11:25,722::task::794::TaskManager.Task::(resourceAcquired) Task=`f199110d-6311-4fbd-a270-2d489b73c903`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (shared) >Thread-728::DEBUG::2012-11-29 15:11:25,722::task::957::TaskManager.Task::(_decref) Task=`f199110d-6311-4fbd-a270-2d489b73c903`::ref 1 aborting False >Thread-728::INFO::2012-11-29 15:11:25,725::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': '76a4921b-744d-4d18-9b01-f1754c79020d', 'master_ver': 0, 'lver': -1, 'version': '0', 'role': 'Regular', 'remotePath': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'spm_id': -1, 'type': 'NFS', 'class': 'Backup', 'pool': [], 'name': 'ExportDomainRest'}} >Thread-728::DEBUG::2012-11-29 15:11:25,725::task::1151::TaskManager.Task::(prepare) Task=`f199110d-6311-4fbd-a270-2d489b73c903`::finished: {'info': {'uuid': '76a4921b-744d-4d18-9b01-f1754c79020d', 'master_ver': 0, 'lver': -1, 'version': '0', 'role': 'Regular', 'remotePath': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'spm_id': -1, 'type': 'NFS', 'class': 'Backup', 'pool': [], 'name': 'ExportDomainRest'}} >Thread-728::DEBUG::2012-11-29 15:11:25,725::task::568::TaskManager.Task::(_updateState) Task=`f199110d-6311-4fbd-a270-2d489b73c903`::moving from state preparing -> state finished >Thread-728::DEBUG::2012-11-29 15:11:25,725::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-728::DEBUG::2012-11-29 15:11:25,726::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-728::DEBUG::2012-11-29 15:11:25,726::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-728::DEBUG::2012-11-29 15:11:25,726::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-728::DEBUG::2012-11-29 15:11:25,726::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-728::DEBUG::2012-11-29 15:11:25,726::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-728::DEBUG::2012-11-29 15:11:25,727::task::957::TaskManager.Task::(_decref) Task=`f199110d-6311-4fbd-a270-2d489b73c903`::ref 0 aborting False >Thread-729::DEBUG::2012-11-29 15:11:25,784::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-729::DEBUG::2012-11-29 15:11:25,785::task::568::TaskManager.Task::(_updateState) Task=`8d9a2367-593e-415c-9b70-652f595b2bed`::moving from state init -> state preparing >Thread-729::INFO::2012-11-29 15:11:25,785::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=3, storageType=1, remotePath='', options=None) >Thread-729::DEBUG::2012-11-29 15:11:25,785::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-729::DEBUG::2012-11-29 15:11:25,785::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-729::DEBUG::2012-11-29 15:11:25,785::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-729::DEBUG::2012-11-29 15:11:25,786::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-729::DEBUG::2012-11-29 15:11:25,786::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-729::DEBUG::2012-11-29 15:11:25,799::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-729::DEBUG::2012-11-29 15:11:25,800::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-729::DEBUG::2012-11-29 15:11:25,802::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-729::DEBUG::2012-11-29 15:11:25,804::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-729::DEBUG::2012-11-29 15:11:25,806::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-729::DEBUG::2012-11-29 15:11:25,808::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-729::DEBUG::2012-11-29 15:11:25,810::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-729::DEBUG::2012-11-29 15:11:25,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-729::DEBUG::2012-11-29 15:11:25,814::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-729::DEBUG::2012-11-29 15:11:25,816::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-730::DEBUG::2012-11-29 15:11:26,889::task::568::TaskManager.Task::(_updateState) Task=`8e003ca0-ff8a-4cfc-ad13-c8ee2035259d`::moving from state init -> state preparing >Thread-730::INFO::2012-11-29 15:11:26,889::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-730::INFO::2012-11-29 15:11:26,889::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00246691703796', 'lastCheck': '3.2', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00212693214417', 'lastCheck': '5.4', 'code': 0, 'valid': True}} >Thread-730::DEBUG::2012-11-29 15:11:26,890::task::1151::TaskManager.Task::(prepare) Task=`8e003ca0-ff8a-4cfc-ad13-c8ee2035259d`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00246691703796', 'lastCheck': '3.2', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00212693214417', 'lastCheck': '5.4', 'code': 0, 'valid': True}} >Thread-730::DEBUG::2012-11-29 15:11:26,890::task::568::TaskManager.Task::(_updateState) Task=`8e003ca0-ff8a-4cfc-ad13-c8ee2035259d`::moving from state preparing -> state finished >Thread-730::DEBUG::2012-11-29 15:11:26,890::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-730::DEBUG::2012-11-29 15:11:26,890::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-730::DEBUG::2012-11-29 15:11:26,890::task::957::TaskManager.Task::(_decref) Task=`8e003ca0-ff8a-4cfc-ad13-c8ee2035259d`::ref 0 aborting False >Thread-729::DEBUG::2012-11-29 15:11:27,819::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-729::DEBUG::2012-11-29 15:11:27,865::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-729::DEBUG::2012-11-29 15:11:27,866::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-729::DEBUG::2012-11-29 15:11:27,866::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-729::DEBUG::2012-11-29 15:11:27,866::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-729::DEBUG::2012-11-29 15:11:27,867::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-729::DEBUG::2012-11-29 15:11:27,867::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-729::DEBUG::2012-11-29 15:11:27,867::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-729::DEBUG::2012-11-29 15:11:27,867::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-729::DEBUG::2012-11-29 15:11:27,868::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-729::DEBUG::2012-11-29 15:11:27,868::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-729::DEBUG::2012-11-29 15:11:28,011::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-729::DEBUG::2012-11-29 15:11:28,012::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-729::INFO::2012-11-29 15:11:28,018::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': ['76a4921b-744d-4d18-9b01-f1754c79020d']} >Thread-729::DEBUG::2012-11-29 15:11:28,018::task::1151::TaskManager.Task::(prepare) Task=`8d9a2367-593e-415c-9b70-652f595b2bed`::finished: {'domlist': ['76a4921b-744d-4d18-9b01-f1754c79020d']} >Thread-729::DEBUG::2012-11-29 15:11:28,018::task::568::TaskManager.Task::(_updateState) Task=`8d9a2367-593e-415c-9b70-652f595b2bed`::moving from state preparing -> state finished >Thread-729::DEBUG::2012-11-29 15:11:28,018::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-729::DEBUG::2012-11-29 15:11:28,019::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-729::DEBUG::2012-11-29 15:11:28,019::task::957::TaskManager.Task::(_decref) Task=`8d9a2367-593e-415c-9b70-652f595b2bed`::ref 0 aborting False >Thread-735::DEBUG::2012-11-29 15:11:28,046::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-735::DEBUG::2012-11-29 15:11:28,047::task::568::TaskManager.Task::(_updateState) Task=`57a4cda5-bf52-4930-a049-124ce3563bba`::moving from state init -> state preparing >Thread-735::INFO::2012-11-29 15:11:28,047::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', options=None) >Thread-735::INFO::2012-11-29 15:11:28,047::fileSD::302::Storage.StorageDomain::(validate) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d >Thread-735::DEBUG::2012-11-29 15:11:28,050::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-735::DEBUG::2012-11-29 15:11:28,051::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`b44fbfa0-f770-4cdc-8e3e-e558a242bbb9`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-735::DEBUG::2012-11-29 15:11:28,051::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'shared' >Thread-735::DEBUG::2012-11-29 15:11:28,051::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'shared' (1 active user) >Thread-735::DEBUG::2012-11-29 15:11:28,051::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`b44fbfa0-f770-4cdc-8e3e-e558a242bbb9`::Granted request >Thread-735::DEBUG::2012-11-29 15:11:28,052::task::794::TaskManager.Task::(resourceAcquired) Task=`57a4cda5-bf52-4930-a049-124ce3563bba`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (shared) >Thread-735::DEBUG::2012-11-29 15:11:28,052::task::957::TaskManager.Task::(_decref) Task=`57a4cda5-bf52-4930-a049-124ce3563bba`::ref 1 aborting False >Thread-735::INFO::2012-11-29 15:11:28,055::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': '76a4921b-744d-4d18-9b01-f1754c79020d', 'master_ver': 0, 'lver': -1, 'version': '0', 'role': 'Regular', 'remotePath': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'spm_id': -1, 'type': 'NFS', 'class': 'Backup', 'pool': [], 'name': 'ExportDomainRest'}} >Thread-735::DEBUG::2012-11-29 15:11:28,055::task::1151::TaskManager.Task::(prepare) Task=`57a4cda5-bf52-4930-a049-124ce3563bba`::finished: {'info': {'uuid': '76a4921b-744d-4d18-9b01-f1754c79020d', 'master_ver': 0, 'lver': -1, 'version': '0', 'role': 'Regular', 'remotePath': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'spm_id': -1, 'type': 'NFS', 'class': 'Backup', 'pool': [], 'name': 'ExportDomainRest'}} >Thread-735::DEBUG::2012-11-29 15:11:28,055::task::568::TaskManager.Task::(_updateState) Task=`57a4cda5-bf52-4930-a049-124ce3563bba`::moving from state preparing -> state finished >Thread-735::DEBUG::2012-11-29 15:11:28,055::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-735::DEBUG::2012-11-29 15:11:28,055::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-735::DEBUG::2012-11-29 15:11:28,056::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-735::DEBUG::2012-11-29 15:11:28,056::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-735::DEBUG::2012-11-29 15:11:28,056::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-735::DEBUG::2012-11-29 15:11:28,056::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-735::DEBUG::2012-11-29 15:11:28,057::task::957::TaskManager.Task::(_decref) Task=`57a4cda5-bf52-4930-a049-124ce3563bba`::ref 0 aborting False >Thread-736::DEBUG::2012-11-29 15:11:28,099::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-736::DEBUG::2012-11-29 15:11:28,099::task::568::TaskManager.Task::(_updateState) Task=`08e9993c-2b21-4127-aac9-7c67b3aa55f2`::moving from state init -> state preparing >Thread-736::INFO::2012-11-29 15:11:28,100::logUtils::37::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', options=None) >Thread-736::DEBUG::2012-11-29 15:11:28,100::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`7ba0810d-d982-4868-9ed3-87b3d8843276`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-736::DEBUG::2012-11-29 15:11:28,100::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'shared' >Thread-736::DEBUG::2012-11-29 15:11:28,101::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'shared' (1 active user) >Thread-736::DEBUG::2012-11-29 15:11:28,101::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`7ba0810d-d982-4868-9ed3-87b3d8843276`::Granted request >Thread-736::DEBUG::2012-11-29 15:11:28,101::task::794::TaskManager.Task::(resourceAcquired) Task=`08e9993c-2b21-4127-aac9-7c67b3aa55f2`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (shared) >Thread-736::DEBUG::2012-11-29 15:11:28,101::task::957::TaskManager.Task::(_decref) Task=`08e9993c-2b21-4127-aac9-7c67b3aa55f2`::ref 1 aborting False >Thread-736::INFO::2012-11-29 15:11:28,102::logUtils::39::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861029793792', 'disktotal': '861029793792', 'mdafree': 0}} >Thread-736::DEBUG::2012-11-29 15:11:28,103::task::1151::TaskManager.Task::(prepare) Task=`08e9993c-2b21-4127-aac9-7c67b3aa55f2`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '861029793792', 'disktotal': '861029793792', 'mdafree': 0}} >Thread-736::DEBUG::2012-11-29 15:11:28,103::task::568::TaskManager.Task::(_updateState) Task=`08e9993c-2b21-4127-aac9-7c67b3aa55f2`::moving from state preparing -> state finished >Thread-736::DEBUG::2012-11-29 15:11:28,103::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-736::DEBUG::2012-11-29 15:11:28,103::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-736::DEBUG::2012-11-29 15:11:28,103::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-736::DEBUG::2012-11-29 15:11:28,104::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-736::DEBUG::2012-11-29 15:11:28,104::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-736::DEBUG::2012-11-29 15:11:28,104::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-736::DEBUG::2012-11-29 15:11:28,104::task::957::TaskManager.Task::(_decref) Task=`08e9993c-2b21-4127-aac9-7c67b3aa55f2`::ref 0 aborting False >Thread-738::DEBUG::2012-11-29 15:11:29,188::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-738::DEBUG::2012-11-29 15:11:29,188::task::568::TaskManager.Task::(_updateState) Task=`cc580dc4-9b9d-4ebd-b0f8-0a1169bae586`::moving from state init -> state preparing >Thread-738::INFO::2012-11-29 15:11:29,189::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-738::INFO::2012-11-29 15:11:29,189::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-738::DEBUG::2012-11-29 15:11:29,189::task::1151::TaskManager.Task::(prepare) Task=`cc580dc4-9b9d-4ebd-b0f8-0a1169bae586`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-738::DEBUG::2012-11-29 15:11:29,189::task::568::TaskManager.Task::(_updateState) Task=`cc580dc4-9b9d-4ebd-b0f8-0a1169bae586`::moving from state preparing -> state finished >Thread-738::DEBUG::2012-11-29 15:11:29,189::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-738::DEBUG::2012-11-29 15:11:29,190::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-738::DEBUG::2012-11-29 15:11:29,190::task::957::TaskManager.Task::(_decref) Task=`cc580dc4-9b9d-4ebd-b0f8-0a1169bae586`::ref 0 aborting False >Thread-739::DEBUG::2012-11-29 15:11:29,217::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-739::DEBUG::2012-11-29 15:11:29,218::task::568::TaskManager.Task::(_updateState) Task=`2bcb9cbb-85cc-423c-ac52-9575c365eb4b`::moving from state init -> state preparing >Thread-739::INFO::2012-11-29 15:11:29,218::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-739::INFO::2012-11-29 15:11:29,221::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-739::DEBUG::2012-11-29 15:11:29,221::task::1151::TaskManager.Task::(prepare) Task=`2bcb9cbb-85cc-423c-ac52-9575c365eb4b`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-739::DEBUG::2012-11-29 15:11:29,221::task::568::TaskManager.Task::(_updateState) Task=`2bcb9cbb-85cc-423c-ac52-9575c365eb4b`::moving from state preparing -> state finished >Thread-739::DEBUG::2012-11-29 15:11:29,221::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-739::DEBUG::2012-11-29 15:11:29,221::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-739::DEBUG::2012-11-29 15:11:29,221::task::957::TaskManager.Task::(_decref) Task=`2bcb9cbb-85cc-423c-ac52-9575c365eb4b`::ref 0 aborting False >Thread-740::DEBUG::2012-11-29 15:11:29,247::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-740::DEBUG::2012-11-29 15:11:29,247::task::568::TaskManager.Task::(_updateState) Task=`75200020-531d-4942-a685-bccd90e656cd`::moving from state init -> state preparing >Thread-740::INFO::2012-11-29 15:11:29,247::logUtils::37::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-740::DEBUG::2012-11-29 15:11:29,248::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`634c2bfc-0c70-45aa-b064-258152b7e542`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-740::DEBUG::2012-11-29 15:11:29,248::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-740::DEBUG::2012-11-29 15:11:29,248::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-740::DEBUG::2012-11-29 15:11:29,248::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`634c2bfc-0c70-45aa-b064-258152b7e542`::Granted request >Thread-740::DEBUG::2012-11-29 15:11:29,249::task::794::TaskManager.Task::(resourceAcquired) Task=`75200020-531d-4942-a685-bccd90e656cd`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-740::DEBUG::2012-11-29 15:11:29,249::task::957::TaskManager.Task::(_decref) Task=`75200020-531d-4942-a685-bccd90e656cd`::ref 1 aborting False >Thread-740::DEBUG::2012-11-29 15:11:29,249::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`fb221837-9853-4c98-a8bd-7c5f3db3d292`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-740::DEBUG::2012-11-29 15:11:29,249::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-740::DEBUG::2012-11-29 15:11:29,250::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-740::DEBUG::2012-11-29 15:11:29,250::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`fb221837-9853-4c98-a8bd-7c5f3db3d292`::Granted request >Thread-740::DEBUG::2012-11-29 15:11:29,250::task::794::TaskManager.Task::(resourceAcquired) Task=`75200020-531d-4942-a685-bccd90e656cd`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-740::DEBUG::2012-11-29 15:11:29,250::task::957::TaskManager.Task::(_decref) Task=`75200020-531d-4942-a685-bccd90e656cd`::ref 1 aborting False >Thread-740::INFO::2012-11-29 15:11:29,251::sp::918::Storage.StoragePool::(attachSD) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-740::DEBUG::2012-11-29 15:11:29,253::safelease::94::ClusterLock::(acquire) Acquiring cluster lock for domain 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-740::DEBUG::2012-11-29 15:11:29,254::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c1 -n0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 76a4921b-744d-4d18-9b01-f1754c79020d 1 5 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d/dom_md/leases 5000 1000 3"' (cwd /usr/libexec/vdsm) >Thread-740::DEBUG::2012-11-29 15:11:31,284::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-740::DEBUG::2012-11-29 15:11:31,284::safelease::109::ClusterLock::(acquire) Clustered lock acquired successfully >Thread-740::DEBUG::2012-11-29 15:11:31,288::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-740::DEBUG::2012-11-29 15:11:31,288::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-740::DEBUG::2012-11-29 15:11:31,288::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-740::DEBUG::2012-11-29 15:11:31,288::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-740::DEBUG::2012-11-29 15:11:31,292::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-740::DEBUG::2012-11-29 15:11:31,292::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-740::DEBUG::2012-11-29 15:11:31,292::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-740::DEBUG::2012-11-29 15:11:31,293::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8126459fd7f4957b0047ddc803a6ad59b150194'] >Thread-740::DEBUG::2012-11-29 15:11:31,296::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-740::INFO::2012-11-29 15:11:31,296::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-740::DEBUG::2012-11-29 15:11:31,296::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-740::DEBUG::2012-11-29 15:11:31,296::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-740::DEBUG::2012-11-29 15:11:31,297::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-740::DEBUG::2012-11-29 15:11:31,297::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-740::INFO::2012-11-29 15:11:31,297::safelease::119::ClusterLock::(release) Releasing cluster lock for domain 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-740::DEBUG::2012-11-29 15:11:31,297::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/libexec/vdsm/spmstop.sh 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd /usr/libexec/vdsm) >Thread-740::DEBUG::2012-11-29 15:11:32,353::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-740::DEBUG::2012-11-29 15:11:32,353::safelease::126::ClusterLock::(release) Cluster lock released successfully >Thread-740::DEBUG::2012-11-29 15:11:32,353::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-740::DEBUG::2012-11-29 15:11:32,354::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-740::DEBUG::2012-11-29 15:11:32,354::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-740::INFO::2012-11-29 15:11:32,354::logUtils::39::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-740::DEBUG::2012-11-29 15:11:32,354::task::1151::TaskManager.Task::(prepare) Task=`75200020-531d-4942-a685-bccd90e656cd`::finished: None >Thread-740::DEBUG::2012-11-29 15:11:32,355::task::568::TaskManager.Task::(_updateState) Task=`75200020-531d-4942-a685-bccd90e656cd`::moving from state preparing -> state finished >Thread-740::DEBUG::2012-11-29 15:11:32,355::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-740::DEBUG::2012-11-29 15:11:32,355::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-740::DEBUG::2012-11-29 15:11:32,355::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-740::DEBUG::2012-11-29 15:11:32,356::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-740::DEBUG::2012-11-29 15:11:32,356::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-740::DEBUG::2012-11-29 15:11:32,356::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-740::DEBUG::2012-11-29 15:11:32,356::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-740::DEBUG::2012-11-29 15:11:32,356::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-740::DEBUG::2012-11-29 15:11:32,357::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-740::DEBUG::2012-11-29 15:11:32,357::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-740::DEBUG::2012-11-29 15:11:32,357::task::957::TaskManager.Task::(_decref) Task=`75200020-531d-4942-a685-bccd90e656cd`::ref 0 aborting False >Thread-742::DEBUG::2012-11-29 15:11:32,390::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-742::DEBUG::2012-11-29 15:11:32,390::task::568::TaskManager.Task::(_updateState) Task=`e118f72e-76d0-403c-9220-b0ff5ca42382`::moving from state init -> state preparing >Thread-742::INFO::2012-11-29 15:11:32,390::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-742::INFO::2012-11-29 15:11:32,391::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-742::DEBUG::2012-11-29 15:11:32,391::task::1151::TaskManager.Task::(prepare) Task=`e118f72e-76d0-403c-9220-b0ff5ca42382`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-742::DEBUG::2012-11-29 15:11:32,391::task::568::TaskManager.Task::(_updateState) Task=`e118f72e-76d0-403c-9220-b0ff5ca42382`::moving from state preparing -> state finished >Thread-742::DEBUG::2012-11-29 15:11:32,391::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-742::DEBUG::2012-11-29 15:11:32,391::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-742::DEBUG::2012-11-29 15:11:32,392::task::957::TaskManager.Task::(_decref) Task=`e118f72e-76d0-403c-9220-b0ff5ca42382`::ref 0 aborting False >Thread-743::DEBUG::2012-11-29 15:11:32,428::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-743::DEBUG::2012-11-29 15:11:32,429::task::568::TaskManager.Task::(_updateState) Task=`16dbbbe1-9de6-48b6-b98c-e3fdafeae041`::moving from state init -> state preparing >Thread-743::INFO::2012-11-29 15:11:32,429::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-743::DEBUG::2012-11-29 15:11:32,429::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`9a8b38a6-e2d7-4316-8297-b1c3929bbc20`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-743::DEBUG::2012-11-29 15:11:32,429::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-743::DEBUG::2012-11-29 15:11:32,430::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-743::DEBUG::2012-11-29 15:11:32,430::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`9a8b38a6-e2d7-4316-8297-b1c3929bbc20`::Granted request >Thread-743::DEBUG::2012-11-29 15:11:32,430::task::794::TaskManager.Task::(resourceAcquired) Task=`16dbbbe1-9de6-48b6-b98c-e3fdafeae041`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-743::DEBUG::2012-11-29 15:11:32,430::task::957::TaskManager.Task::(_decref) Task=`16dbbbe1-9de6-48b6-b98c-e3fdafeae041`::ref 1 aborting False >Thread-743::INFO::2012-11-29 15:11:32,433::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'status': 'Attached'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}}} >Thread-743::DEBUG::2012-11-29 15:11:32,434::task::1151::TaskManager.Task::(prepare) Task=`16dbbbe1-9de6-48b6-b98c-e3fdafeae041`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'status': 'Attached'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}}} >Thread-743::DEBUG::2012-11-29 15:11:32,434::task::568::TaskManager.Task::(_updateState) Task=`16dbbbe1-9de6-48b6-b98c-e3fdafeae041`::moving from state preparing -> state finished >Thread-743::DEBUG::2012-11-29 15:11:32,434::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-743::DEBUG::2012-11-29 15:11:32,434::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-743::DEBUG::2012-11-29 15:11:32,435::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-743::DEBUG::2012-11-29 15:11:32,435::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-743::DEBUG::2012-11-29 15:11:32,435::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-743::DEBUG::2012-11-29 15:11:32,435::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-743::DEBUG::2012-11-29 15:11:32,435::task::957::TaskManager.Task::(_decref) Task=`16dbbbe1-9de6-48b6-b98c-e3fdafeae041`::ref 0 aborting False >Thread-745::DEBUG::2012-11-29 15:11:33,976::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-745::DEBUG::2012-11-29 15:11:33,977::task::568::TaskManager.Task::(_updateState) Task=`5edd258a-2e24-410c-82ed-cb0e3e0387d0`::moving from state init -> state preparing >Thread-745::INFO::2012-11-29 15:11:33,977::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-745::INFO::2012-11-29 15:11:33,977::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-745::DEBUG::2012-11-29 15:11:33,977::task::1151::TaskManager.Task::(prepare) Task=`5edd258a-2e24-410c-82ed-cb0e3e0387d0`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-745::DEBUG::2012-11-29 15:11:33,977::task::568::TaskManager.Task::(_updateState) Task=`5edd258a-2e24-410c-82ed-cb0e3e0387d0`::moving from state preparing -> state finished >Thread-745::DEBUG::2012-11-29 15:11:33,977::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-745::DEBUG::2012-11-29 15:11:33,978::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-745::DEBUG::2012-11-29 15:11:33,978::task::957::TaskManager.Task::(_decref) Task=`5edd258a-2e24-410c-82ed-cb0e3e0387d0`::ref 0 aborting False >Thread-746::DEBUG::2012-11-29 15:11:34,005::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-746::DEBUG::2012-11-29 15:11:34,005::task::568::TaskManager.Task::(_updateState) Task=`7ff1bcf5-32c7-4998-8fbd-65fe4992d09f`::moving from state init -> state preparing >Thread-746::INFO::2012-11-29 15:11:34,006::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-746::INFO::2012-11-29 15:11:34,008::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-746::DEBUG::2012-11-29 15:11:34,008::task::1151::TaskManager.Task::(prepare) Task=`7ff1bcf5-32c7-4998-8fbd-65fe4992d09f`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-746::DEBUG::2012-11-29 15:11:34,008::task::568::TaskManager.Task::(_updateState) Task=`7ff1bcf5-32c7-4998-8fbd-65fe4992d09f`::moving from state preparing -> state finished >Thread-746::DEBUG::2012-11-29 15:11:34,008::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-746::DEBUG::2012-11-29 15:11:34,008::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-746::DEBUG::2012-11-29 15:11:34,008::task::957::TaskManager.Task::(_decref) Task=`7ff1bcf5-32c7-4998-8fbd-65fe4992d09f`::ref 0 aborting False >Thread-747::DEBUG::2012-11-29 15:11:34,033::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-747::DEBUG::2012-11-29 15:11:34,034::task::568::TaskManager.Task::(_updateState) Task=`dbad1012-b304-4fee-98cb-3a3bddca44db`::moving from state init -> state preparing >Thread-747::INFO::2012-11-29 15:11:34,034::logUtils::37::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-747::DEBUG::2012-11-29 15:11:34,034::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`42820ab4-6207-4317-9ed8-1891d60c264e`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-747::DEBUG::2012-11-29 15:11:34,034::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-747::DEBUG::2012-11-29 15:11:34,034::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-747::DEBUG::2012-11-29 15:11:34,035::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`42820ab4-6207-4317-9ed8-1891d60c264e`::Granted request >Thread-747::DEBUG::2012-11-29 15:11:34,035::task::794::TaskManager.Task::(resourceAcquired) Task=`dbad1012-b304-4fee-98cb-3a3bddca44db`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-747::DEBUG::2012-11-29 15:11:34,035::task::957::TaskManager.Task::(_decref) Task=`dbad1012-b304-4fee-98cb-3a3bddca44db`::ref 1 aborting False >Thread-747::DEBUG::2012-11-29 15:11:34,035::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`4e888dbd-6a80-43d0-8083-eebabbbd35de`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-747::DEBUG::2012-11-29 15:11:34,036::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-747::DEBUG::2012-11-29 15:11:34,036::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-747::DEBUG::2012-11-29 15:11:34,036::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`4e888dbd-6a80-43d0-8083-eebabbbd35de`::Granted request >Thread-747::DEBUG::2012-11-29 15:11:34,037::task::794::TaskManager.Task::(resourceAcquired) Task=`dbad1012-b304-4fee-98cb-3a3bddca44db`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-747::DEBUG::2012-11-29 15:11:34,037::task::957::TaskManager.Task::(_decref) Task=`dbad1012-b304-4fee-98cb-3a3bddca44db`::ref 1 aborting False >Thread-747::INFO::2012-11-29 15:11:34,037::sp::1045::Storage.StoragePool::(activateSD) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-747::DEBUG::2012-11-29 15:11:34,039::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-747::DEBUG::2012-11-29 15:11:34,039::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-747::DEBUG::2012-11-29 15:11:34,039::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=333c691f1ce6b2be7e1ace1fb553179a8a155939'] >Thread-747::DEBUG::2012-11-29 15:11:34,043::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-747::INFO::2012-11-29 15:11:34,043::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-747::DEBUG::2012-11-29 15:11:34,043::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-747::DEBUG::2012-11-29 15:11:34,044::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-747::DEBUG::2012-11-29 15:11:34,044::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-747::DEBUG::2012-11-29 15:11:34,044::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-747::DEBUG::2012-11-29 15:11:34,044::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-747::DEBUG::2012-11-29 15:11:34,044::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-748::DEBUG::2012-11-29 15:11:34,045::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-747::DEBUG::2012-11-29 15:11:34,045::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` started monitoring domain `76a4921b-744d-4d18-9b01-f1754c79020d` >Thread-747::DEBUG::2012-11-29 15:11:34,045::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-747::INFO::2012-11-29 15:11:34,046::logUtils::39::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-747::DEBUG::2012-11-29 15:11:34,046::task::1151::TaskManager.Task::(prepare) Task=`dbad1012-b304-4fee-98cb-3a3bddca44db`::finished: None >Thread-747::DEBUG::2012-11-29 15:11:34,047::task::568::TaskManager.Task::(_updateState) Task=`dbad1012-b304-4fee-98cb-3a3bddca44db`::moving from state preparing -> state finished >Thread-747::DEBUG::2012-11-29 15:11:34,048::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-747::DEBUG::2012-11-29 15:11:34,048::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-747::DEBUG::2012-11-29 15:11:34,048::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-747::DEBUG::2012-11-29 15:11:34,049::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-747::DEBUG::2012-11-29 15:11:34,049::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-747::DEBUG::2012-11-29 15:11:34,049::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-747::DEBUG::2012-11-29 15:11:34,050::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-747::DEBUG::2012-11-29 15:11:34,050::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-747::DEBUG::2012-11-29 15:11:34,050::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-747::DEBUG::2012-11-29 15:11:34,051::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-747::DEBUG::2012-11-29 15:11:34,051::task::957::TaskManager.Task::(_decref) Task=`dbad1012-b304-4fee-98cb-3a3bddca44db`::ref 0 aborting False >Thread-749::DEBUG::2012-11-29 15:11:34,104::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-749::DEBUG::2012-11-29 15:11:34,104::task::568::TaskManager.Task::(_updateState) Task=`3ccbb7f4-0b55-47b0-8d42-ca3e135031a1`::moving from state init -> state preparing >Thread-749::INFO::2012-11-29 15:11:34,104::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-749::DEBUG::2012-11-29 15:11:34,105::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`5fb41dd8-afdb-480b-9a1f-d0a067f2ed77`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-749::DEBUG::2012-11-29 15:11:34,105::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-749::DEBUG::2012-11-29 15:11:34,105::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-749::DEBUG::2012-11-29 15:11:34,105::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`5fb41dd8-afdb-480b-9a1f-d0a067f2ed77`::Granted request >Thread-749::DEBUG::2012-11-29 15:11:34,106::task::794::TaskManager.Task::(resourceAcquired) Task=`3ccbb7f4-0b55-47b0-8d42-ca3e135031a1`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-749::DEBUG::2012-11-29 15:11:34,106::task::957::TaskManager.Task::(_decref) Task=`3ccbb7f4-0b55-47b0-8d42-ca3e135031a1`::ref 1 aborting False >Thread-749::INFO::2012-11-29 15:11:34,106::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-749::DEBUG::2012-11-29 15:11:34,109::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=333c691f1ce6b2be7e1ace1fb553179a8a155939'] >Thread-749::DEBUG::2012-11-29 15:11:34,109::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:34,109::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:34,110::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:34,110::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:34,110::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:34,110::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:34,111::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-749::DEBUG::2012-11-29 15:11:34,111::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-749::DEBUG::2012-11-29 15:11:34,111::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-749::DEBUG::2012-11-29 15:11:34,111::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-749::DEBUG::2012-11-29 15:11:34,111::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-749::DEBUG::2012-11-29 15:11:34,125::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-749::DEBUG::2012-11-29 15:11:34,125::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-749::DEBUG::2012-11-29 15:11:34,127::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-749::DEBUG::2012-11-29 15:11:35,130::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-749::DEBUG::2012-11-29 15:11:35,133::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-749::DEBUG::2012-11-29 15:11:35,135::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-749::DEBUG::2012-11-29 15:11:35,137::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-749::DEBUG::2012-11-29 15:11:35,139::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-749::DEBUG::2012-11-29 15:11:35,141::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-749::DEBUG::2012-11-29 15:11:35,143::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-751::DEBUG::2012-11-29 15:11:37,086::task::568::TaskManager.Task::(_updateState) Task=`316b74fb-ae81-46d2-928b-1d4894dac20a`::moving from state init -> state preparing >Thread-751::INFO::2012-11-29 15:11:37,086::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-751::INFO::2012-11-29 15:11:37,086::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00245499610901', 'lastCheck': '3.4', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.0026650428772', 'lastCheck': '3.0', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00186705589294', 'lastCheck': '5.6', 'code': 0, 'valid': True}} >Thread-751::DEBUG::2012-11-29 15:11:37,087::task::1151::TaskManager.Task::(prepare) Task=`316b74fb-ae81-46d2-928b-1d4894dac20a`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00245499610901', 'lastCheck': '3.4', 'code': 0, 'valid': True}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'delay': '0.0026650428772', 'lastCheck': '3.0', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00186705589294', 'lastCheck': '5.6', 'code': 0, 'valid': True}} >Thread-751::DEBUG::2012-11-29 15:11:37,087::task::568::TaskManager.Task::(_updateState) Task=`316b74fb-ae81-46d2-928b-1d4894dac20a`::moving from state preparing -> state finished >Thread-751::DEBUG::2012-11-29 15:11:37,087::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-751::DEBUG::2012-11-29 15:11:37,087::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-751::DEBUG::2012-11-29 15:11:37,087::task::957::TaskManager.Task::(_decref) Task=`316b74fb-ae81-46d2-928b-1d4894dac20a`::ref 0 aborting False >Thread-749::DEBUG::2012-11-29 15:11:37,146::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-749::DEBUG::2012-11-29 15:11:37,207::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-749::DEBUG::2012-11-29 15:11:37,207::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,208::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,208::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,208::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,208::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,209::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,209::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-749::DEBUG::2012-11-29 15:11:37,209::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,210::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-749::DEBUG::2012-11-29 15:11:37,364::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-749::WARNING::2012-11-29 15:11:37,366::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-749::DEBUG::2012-11-29 15:11:37,366::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,768::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-749::DEBUG::2012-11-29 15:11:37,768::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-749::DEBUG::2012-11-29 15:11:37,774::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=333c691f1ce6b2be7e1ace1fb553179a8a155939'] >Thread-749::DEBUG::2012-11-29 15:11:37,776::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-749::WARNING::2012-11-29 15:11:37,776::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-749::WARNING::2012-11-29 15:11:37,776::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-749::DEBUG::2012-11-29 15:11:37,777::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-749::DEBUG::2012-11-29 15:11:37,777::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-749::DEBUG::2012-11-29 15:11:37,777::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-749::DEBUG::2012-11-29 15:11:37,777::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-749::WARNING::2012-11-29 15:11:37,778::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-749::DEBUG::2012-11-29 15:11:37,778::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-749::DEBUG::2012-11-29 15:11:37,779::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-749::DEBUG::2012-11-29 15:11:37,930::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-749::WARNING::2012-11-29 15:11:37,931::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found', ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-749::DEBUG::2012-11-29 15:11:37,932::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-749::INFO::2012-11-29 15:11:37,938::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-749::INFO::2012-11-29 15:11:37,938::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-749::INFO::2012-11-29 15:11:37,939::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-749::INFO::2012-11-29 15:11:37,939::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-749::INFO::2012-11-29 15:11:37,939::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-749::DEBUG::2012-11-29 15:11:37,940::task::1151::TaskManager.Task::(prepare) Task=`3ccbb7f4-0b55-47b0-8d42-ca3e135031a1`::finished: None >Thread-749::DEBUG::2012-11-29 15:11:37,940::task::568::TaskManager.Task::(_updateState) Task=`3ccbb7f4-0b55-47b0-8d42-ca3e135031a1`::moving from state preparing -> state finished >Thread-749::DEBUG::2012-11-29 15:11:37,940::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-749::DEBUG::2012-11-29 15:11:37,940::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-749::DEBUG::2012-11-29 15:11:37,940::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-749::DEBUG::2012-11-29 15:11:37,941::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-749::DEBUG::2012-11-29 15:11:37,941::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-749::DEBUG::2012-11-29 15:11:37,941::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-749::DEBUG::2012-11-29 15:11:37,941::task::957::TaskManager.Task::(_decref) Task=`3ccbb7f4-0b55-47b0-8d42-ca3e135031a1`::ref 0 aborting False >Thread-759::DEBUG::2012-11-29 15:11:39,029::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-759::DEBUG::2012-11-29 15:11:39,029::task::568::TaskManager.Task::(_updateState) Task=`e48fc14e-5f94-4008-904d-84ea1f2cbdc0`::moving from state init -> state preparing >Thread-759::INFO::2012-11-29 15:11:39,029::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-759::DEBUG::2012-11-29 15:11:39,030::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`8ac0f289-a2b7-4480-89f3-15975f409d58`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-759::DEBUG::2012-11-29 15:11:39,030::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-759::DEBUG::2012-11-29 15:11:39,030::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-759::DEBUG::2012-11-29 15:11:39,030::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`8ac0f289-a2b7-4480-89f3-15975f409d58`::Granted request >Thread-759::DEBUG::2012-11-29 15:11:39,031::task::794::TaskManager.Task::(resourceAcquired) Task=`e48fc14e-5f94-4008-904d-84ea1f2cbdc0`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-759::DEBUG::2012-11-29 15:11:39,031::task::957::TaskManager.Task::(_decref) Task=`e48fc14e-5f94-4008-904d-84ea1f2cbdc0`::ref 1 aborting False >Thread-759::DEBUG::2012-11-29 15:11:39,031::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`b30cb146-9193-4888-af0d-9635a4bedb17`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-759::DEBUG::2012-11-29 15:11:39,032::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-759::DEBUG::2012-11-29 15:11:39,032::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-759::DEBUG::2012-11-29 15:11:39,032::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`b30cb146-9193-4888-af0d-9635a4bedb17`::Granted request >Thread-759::DEBUG::2012-11-29 15:11:39,032::task::794::TaskManager.Task::(resourceAcquired) Task=`e48fc14e-5f94-4008-904d-84ea1f2cbdc0`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-759::DEBUG::2012-11-29 15:11:39,033::task::957::TaskManager.Task::(_decref) Task=`e48fc14e-5f94-4008-904d-84ea1f2cbdc0`::ref 1 aborting False >Thread-759::INFO::2012-11-29 15:11:39,033::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-759::DEBUG::2012-11-29 15:11:39,033::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-759::DEBUG::2012-11-29 15:11:39,034::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-759::DEBUG::2012-11-29 15:11:39,184::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-759::WARNING::2012-11-29 15:11:39,185::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-759::DEBUG::2012-11-29 15:11:39,185::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-759::DEBUG::2012-11-29 15:11:39,193::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-759::DEBUG::2012-11-29 15:11:39,194::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-759::DEBUG::2012-11-29 15:11:39,197::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-759::DEBUG::2012-11-29 15:11:39,198::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-759::WARNING::2012-11-29 15:11:39,198::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_imageNS already registered >Thread-759::WARNING::2012-11-29 15:11:39,199::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS already registered >Thread-759::DEBUG::2012-11-29 15:11:39,201::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-759::DEBUG::2012-11-29 15:11:39,201::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-759::DEBUG::2012-11-29 15:11:39,202::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8126459fd7f4957b0047ddc803a6ad59b150194'] >Thread-759::DEBUG::2012-11-29 15:11:39,205::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-759::DEBUG::2012-11-29 15:11:39,205::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-759::DEBUG::2012-11-29 15:11:39,205::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-748::DEBUG::2012-11-29 15:11:39,206::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-759::DEBUG::2012-11-29 15:11:39,206::sp::1558::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` stopped monitoring domain `76a4921b-744d-4d18-9b01-f1754c79020d` >Thread-759::DEBUG::2012-11-29 15:11:39,206::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-759::INFO::2012-11-29 15:11:39,206::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-759::DEBUG::2012-11-29 15:11:39,207::task::1151::TaskManager.Task::(prepare) Task=`e48fc14e-5f94-4008-904d-84ea1f2cbdc0`::finished: None >Thread-759::DEBUG::2012-11-29 15:11:39,207::task::568::TaskManager.Task::(_updateState) Task=`e48fc14e-5f94-4008-904d-84ea1f2cbdc0`::moving from state preparing -> state finished >Thread-759::DEBUG::2012-11-29 15:11:39,207::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-759::DEBUG::2012-11-29 15:11:39,207::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-759::DEBUG::2012-11-29 15:11:39,208::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-759::DEBUG::2012-11-29 15:11:39,208::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-759::DEBUG::2012-11-29 15:11:39,208::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-759::DEBUG::2012-11-29 15:11:39,208::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-759::DEBUG::2012-11-29 15:11:39,209::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-759::DEBUG::2012-11-29 15:11:39,209::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-759::DEBUG::2012-11-29 15:11:39,209::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-759::DEBUG::2012-11-29 15:11:39,209::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-759::DEBUG::2012-11-29 15:11:39,209::task::957::TaskManager.Task::(_decref) Task=`e48fc14e-5f94-4008-904d-84ea1f2cbdc0`::ref 0 aborting False >Thread-764::DEBUG::2012-11-29 15:11:39,264::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-764::DEBUG::2012-11-29 15:11:39,265::task::568::TaskManager.Task::(_updateState) Task=`58c394ad-339e-490b-8e2d-498dfaca19a4`::moving from state init -> state preparing >Thread-764::INFO::2012-11-29 15:11:39,265::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-764::DEBUG::2012-11-29 15:11:39,265::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`11fb9b80-d274-40f0-a91c-b287092308aa`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-764::DEBUG::2012-11-29 15:11:39,265::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-764::DEBUG::2012-11-29 15:11:39,266::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-764::DEBUG::2012-11-29 15:11:39,266::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`11fb9b80-d274-40f0-a91c-b287092308aa`::Granted request >Thread-764::DEBUG::2012-11-29 15:11:39,266::task::794::TaskManager.Task::(resourceAcquired) Task=`58c394ad-339e-490b-8e2d-498dfaca19a4`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-764::DEBUG::2012-11-29 15:11:39,266::task::957::TaskManager.Task::(_decref) Task=`58c394ad-339e-490b-8e2d-498dfaca19a4`::ref 1 aborting False >Thread-764::INFO::2012-11-29 15:11:39,267::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-764::DEBUG::2012-11-29 15:11:39,270::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8126459fd7f4957b0047ddc803a6ad59b150194'] >Thread-764::DEBUG::2012-11-29 15:11:39,271::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,271::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,271::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,271::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,272::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,272::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,272::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,273::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-764::DEBUG::2012-11-29 15:11:39,424::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-764::WARNING::2012-11-29 15:11:39,425::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-764::DEBUG::2012-11-29 15:11:39,425::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,434::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-764::DEBUG::2012-11-29 15:11:39,435::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-764::DEBUG::2012-11-29 15:11:39,437::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8126459fd7f4957b0047ddc803a6ad59b150194'] >Thread-764::DEBUG::2012-11-29 15:11:39,439::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-764::WARNING::2012-11-29 15:11:39,439::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-764::WARNING::2012-11-29 15:11:39,439::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-764::DEBUG::2012-11-29 15:11:39,439::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-764::DEBUG::2012-11-29 15:11:39,440::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-764::DEBUG::2012-11-29 15:11:39,440::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-764::DEBUG::2012-11-29 15:11:39,440::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-764::WARNING::2012-11-29 15:11:39,440::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-764::DEBUG::2012-11-29 15:11:39,441::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-764::DEBUG::2012-11-29 15:11:39,441::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-764::DEBUG::2012-11-29 15:11:39,592::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-764::WARNING::2012-11-29 15:11:39,593::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-764::DEBUG::2012-11-29 15:11:39,593::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-764::INFO::2012-11-29 15:11:39,599::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-764::INFO::2012-11-29 15:11:39,599::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-764::INFO::2012-11-29 15:11:39,600::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-764::INFO::2012-11-29 15:11:39,600::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-764::DEBUG::2012-11-29 15:11:39,600::task::1151::TaskManager.Task::(prepare) Task=`58c394ad-339e-490b-8e2d-498dfaca19a4`::finished: None >Thread-764::DEBUG::2012-11-29 15:11:39,601::task::568::TaskManager.Task::(_updateState) Task=`58c394ad-339e-490b-8e2d-498dfaca19a4`::moving from state preparing -> state finished >Thread-764::DEBUG::2012-11-29 15:11:39,601::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-764::DEBUG::2012-11-29 15:11:39,601::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-764::DEBUG::2012-11-29 15:11:39,601::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-764::DEBUG::2012-11-29 15:11:39,602::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-764::DEBUG::2012-11-29 15:11:39,602::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-764::DEBUG::2012-11-29 15:11:39,602::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-764::DEBUG::2012-11-29 15:11:39,602::task::957::TaskManager.Task::(_decref) Task=`58c394ad-339e-490b-8e2d-498dfaca19a4`::ref 0 aborting False >Thread-771::DEBUG::2012-11-29 15:11:39,633::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-771::DEBUG::2012-11-29 15:11:39,633::task::568::TaskManager.Task::(_updateState) Task=`c04557f7-ffea-46ae-a590-8a594907f09f`::moving from state init -> state preparing >Thread-771::INFO::2012-11-29 15:11:39,634::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-771::DEBUG::2012-11-29 15:11:39,634::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-771::DEBUG::2012-11-29 15:11:39,661::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-771::DEBUG::2012-11-29 15:11:39,661::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-771::DEBUG::2012-11-29 15:11:39,661::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-771::DEBUG::2012-11-29 15:11:39,661::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-771::DEBUG::2012-11-29 15:11:39,662::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-771::DEBUG::2012-11-29 15:11:39,675::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-771::DEBUG::2012-11-29 15:11:39,675::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-771::DEBUG::2012-11-29 15:11:39,677::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-771::DEBUG::2012-11-29 15:11:39,679::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-771::DEBUG::2012-11-29 15:11:39,681::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-771::DEBUG::2012-11-29 15:11:39,683::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-771::DEBUG::2012-11-29 15:11:39,686::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-771::DEBUG::2012-11-29 15:11:39,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-771::DEBUG::2012-11-29 15:11:39,690::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-771::DEBUG::2012-11-29 15:11:39,691::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-672::DEBUG::2012-11-29 15:11:41,456::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-771::DEBUG::2012-11-29 15:11:41,695::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-771::DEBUG::2012-11-29 15:11:41,742::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-771::DEBUG::2012-11-29 15:11:41,742::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-771::DEBUG::2012-11-29 15:11:41,743::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-771::DEBUG::2012-11-29 15:11:41,743::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-771::DEBUG::2012-11-29 15:11:41,743::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-771::DEBUG::2012-11-29 15:11:41,744::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-771::DEBUG::2012-11-29 15:11:41,744::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:41,744::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-771::DEBUG::2012-11-29 15:11:41,744::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-672::DEBUG::2012-11-29 15:11:41,746::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-771::INFO::2012-11-29 15:11:41,746::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-672::DEBUG::2012-11-29 15:11:41,747::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-771::DEBUG::2012-11-29 15:11:41,748::task::1151::TaskManager.Task::(prepare) Task=`c04557f7-ffea-46ae-a590-8a594907f09f`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-771::DEBUG::2012-11-29 15:11:41,749::task::568::TaskManager.Task::(_updateState) Task=`c04557f7-ffea-46ae-a590-8a594907f09f`::moving from state preparing -> state finished >Thread-672::DEBUG::2012-11-29 15:11:41,750::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-771::DEBUG::2012-11-29 15:11:41,751::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-771::DEBUG::2012-11-29 15:11:41,757::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-771::DEBUG::2012-11-29 15:11:41,757::task::957::TaskManager.Task::(_decref) Task=`c04557f7-ffea-46ae-a590-8a594907f09f`::ref 0 aborting False >Thread-672::DEBUG::2012-11-29 15:11:41,765::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-672::DEBUG::2012-11-29 15:11:41,765::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-672::DEBUG::2012-11-29 15:11:41,767::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >Thread-773::DEBUG::2012-11-29 15:11:42,491::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-773::DEBUG::2012-11-29 15:11:42,491::task::568::TaskManager.Task::(_updateState) Task=`ae60c58f-2d02-493e-a9f6-850a3a1cb4ec`::moving from state init -> state preparing >Thread-773::INFO::2012-11-29 15:11:42,491::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-773::INFO::2012-11-29 15:11:42,492::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-773::DEBUG::2012-11-29 15:11:42,492::task::1151::TaskManager.Task::(prepare) Task=`ae60c58f-2d02-493e-a9f6-850a3a1cb4ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-773::DEBUG::2012-11-29 15:11:42,492::task::568::TaskManager.Task::(_updateState) Task=`ae60c58f-2d02-493e-a9f6-850a3a1cb4ec`::moving from state preparing -> state finished >Thread-773::DEBUG::2012-11-29 15:11:42,492::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-773::DEBUG::2012-11-29 15:11:42,492::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-773::DEBUG::2012-11-29 15:11:42,493::task::957::TaskManager.Task::(_decref) Task=`ae60c58f-2d02-493e-a9f6-850a3a1cb4ec`::ref 0 aborting False >Thread-774::DEBUG::2012-11-29 15:11:42,521::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-774::DEBUG::2012-11-29 15:11:42,521::task::568::TaskManager.Task::(_updateState) Task=`26aebe72-9dc7-41d1-8310-b4198c4a5380`::moving from state init -> state preparing >Thread-774::INFO::2012-11-29 15:11:42,521::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-774::DEBUG::2012-11-29 15:11:42,522::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`83e90370-099e-4f1c-8bb9-2884b70e80b3`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-774::DEBUG::2012-11-29 15:11:42,522::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-774::DEBUG::2012-11-29 15:11:42,522::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-774::DEBUG::2012-11-29 15:11:42,523::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`83e90370-099e-4f1c-8bb9-2884b70e80b3`::Granted request >Thread-774::DEBUG::2012-11-29 15:11:42,523::task::794::TaskManager.Task::(resourceAcquired) Task=`26aebe72-9dc7-41d1-8310-b4198c4a5380`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-774::DEBUG::2012-11-29 15:11:42,523::task::957::TaskManager.Task::(_decref) Task=`26aebe72-9dc7-41d1-8310-b4198c4a5380`::ref 1 aborting False >MainProcess|Thread-672::DEBUG::2012-11-29 15:11:42,771::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-672::DEBUG::2012-11-29 15:11:42,773::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-672::DEBUG::2012-11-29 15:11:42,775::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-672::DEBUG::2012-11-29 15:11:42,777::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >Thread-775::DEBUG::2012-11-29 15:11:43,083::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-775::DEBUG::2012-11-29 15:11:43,083::task::568::TaskManager.Task::(_updateState) Task=`d916831a-dde6-45a0-83fd-11b601aec6c7`::moving from state init -> state preparing >Thread-775::INFO::2012-11-29 15:11:43,084::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-775::INFO::2012-11-29 15:11:43,084::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-775::DEBUG::2012-11-29 15:11:43,084::task::1151::TaskManager.Task::(prepare) Task=`d916831a-dde6-45a0-83fd-11b601aec6c7`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-775::DEBUG::2012-11-29 15:11:43,084::task::568::TaskManager.Task::(_updateState) Task=`d916831a-dde6-45a0-83fd-11b601aec6c7`::moving from state preparing -> state finished >Thread-775::DEBUG::2012-11-29 15:11:43,084::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-775::DEBUG::2012-11-29 15:11:43,084::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-775::DEBUG::2012-11-29 15:11:43,085::task::957::TaskManager.Task::(_decref) Task=`d916831a-dde6-45a0-83fd-11b601aec6c7`::ref 0 aborting False >Thread-776::DEBUG::2012-11-29 15:11:43,113::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-776::DEBUG::2012-11-29 15:11:43,114::task::568::TaskManager.Task::(_updateState) Task=`538c7815-2b25-433b-a810-0b40a30fc23d`::moving from state init -> state preparing >Thread-776::INFO::2012-11-29 15:11:43,114::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-776::DEBUG::2012-11-29 15:11:43,116::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-776::INFO::2012-11-29 15:11:43,144::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-776::DEBUG::2012-11-29 15:11:43,144::task::1151::TaskManager.Task::(prepare) Task=`538c7815-2b25-433b-a810-0b40a30fc23d`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-776::DEBUG::2012-11-29 15:11:43,144::task::568::TaskManager.Task::(_updateState) Task=`538c7815-2b25-433b-a810-0b40a30fc23d`::moving from state preparing -> state finished >Thread-776::DEBUG::2012-11-29 15:11:43,145::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-776::DEBUG::2012-11-29 15:11:43,145::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-776::DEBUG::2012-11-29 15:11:43,145::task::957::TaskManager.Task::(_decref) Task=`538c7815-2b25-433b-a810-0b40a30fc23d`::ref 0 aborting False >MainProcess|Thread-672::DEBUG::2012-11-29 15:11:43,781::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-672::DEBUG::2012-11-29 15:11:43,783::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-672::DEBUG::2012-11-29 15:11:43,785::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-672::DEBUG::2012-11-29 15:11:45,789::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-672::DEBUG::2012-11-29 15:11:45,841::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-672::DEBUG::2012-11-29 15:11:45,841::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:45,842::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:45,842::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:45,842::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:45,842::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:45,842::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:45,843::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-672::DEBUG::2012-11-29 15:11:45,843::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:45,844::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-672::DEBUG::2012-11-29 15:11:45,995::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-672::WARNING::2012-11-29 15:11:45,995::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-672::DEBUG::2012-11-29 15:11:45,997::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-672::DEBUG::2012-11-29 15:11:46,005::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-672::DEBUG::2012-11-29 15:11:46,005::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-672::DEBUG::2012-11-29 15:11:46,009::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9b0b5035d83a6ecb376ae2792c24d6f80f9f8e83'] >Thread-672::DEBUG::2012-11-29 15:11:46,010::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-672::WARNING::2012-11-29 15:11:46,010::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_imageNS already registered >Thread-672::WARNING::2012-11-29 15:11:46,011::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_volumeNS already registered >Thread-774::INFO::2012-11-29 15:11:46,012::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'status': 'Attached'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}}} >Thread-774::DEBUG::2012-11-29 15:11:46,013::task::1151::TaskManager.Task::(prepare) Task=`26aebe72-9dc7-41d1-8310-b4198c4a5380`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,76a4921b-744d-4d18-9b01-f1754c79020d:Attached,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}, '76a4921b-744d-4d18-9b01-f1754c79020d': {'status': 'Attached'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Active', 'diskfree': '861029793792', 'alerts': [], 'disktotal': '861031890944'}}} >Thread-774::DEBUG::2012-11-29 15:11:46,014::task::568::TaskManager.Task::(_updateState) Task=`26aebe72-9dc7-41d1-8310-b4198c4a5380`::moving from state preparing -> state finished >Thread-774::DEBUG::2012-11-29 15:11:46,015::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-774::DEBUG::2012-11-29 15:11:46,017::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-774::DEBUG::2012-11-29 15:11:46,019::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-774::DEBUG::2012-11-29 15:11:46,021::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-774::DEBUG::2012-11-29 15:11:46,022::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-774::DEBUG::2012-11-29 15:11:46,024::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-774::DEBUG::2012-11-29 15:11:46,025::task::957::TaskManager.Task::(_decref) Task=`26aebe72-9dc7-41d1-8310-b4198c4a5380`::ref 0 aborting False >Thread-782::DEBUG::2012-11-29 15:11:46,076::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-782::DEBUG::2012-11-29 15:11:46,076::task::568::TaskManager.Task::(_updateState) Task=`0c7c18ee-0b80-4eb7-a44b-175b1fc899e8`::moving from state init -> state preparing >Thread-782::INFO::2012-11-29 15:11:46,077::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-782::DEBUG::2012-11-29 15:11:46,077::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`1ff86430-2d12-4c89-bc8d-66c38ac2f058`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-782::DEBUG::2012-11-29 15:11:46,077::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-782::DEBUG::2012-11-29 15:11:46,078::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-782::DEBUG::2012-11-29 15:11:46,078::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`1ff86430-2d12-4c89-bc8d-66c38ac2f058`::Granted request >Thread-782::DEBUG::2012-11-29 15:11:46,078::task::794::TaskManager.Task::(resourceAcquired) Task=`0c7c18ee-0b80-4eb7-a44b-175b1fc899e8`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-782::DEBUG::2012-11-29 15:11:46,078::task::957::TaskManager.Task::(_decref) Task=`0c7c18ee-0b80-4eb7-a44b-175b1fc899e8`::ref 1 aborting False >Thread-782::DEBUG::2012-11-29 15:11:46,079::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`a17d7742-9113-4341-94ef-2be2fb57c48a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-782::DEBUG::2012-11-29 15:11:46,079::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-782::DEBUG::2012-11-29 15:11:46,079::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-782::DEBUG::2012-11-29 15:11:46,079::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`a17d7742-9113-4341-94ef-2be2fb57c48a`::Granted request >Thread-782::DEBUG::2012-11-29 15:11:46,080::task::794::TaskManager.Task::(resourceAcquired) Task=`0c7c18ee-0b80-4eb7-a44b-175b1fc899e8`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-782::DEBUG::2012-11-29 15:11:46,080::task::957::TaskManager.Task::(_decref) Task=`0c7c18ee-0b80-4eb7-a44b-175b1fc899e8`::ref 1 aborting False >Thread-782::INFO::2012-11-29 15:11:46,080::sp::984::Storage.StoragePool::(detachSD) sdUUID=76a4921b-744d-4d18-9b01-f1754c79020d spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-782::DEBUG::2012-11-29 15:11:46,080::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-782::DEBUG::2012-11-29 15:11:46,080::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-782::DEBUG::2012-11-29 15:11:46,081::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-782::DEBUG::2012-11-29 15:11:46,081::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-782::DEBUG::2012-11-29 15:11:46,081::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-782::DEBUG::2012-11-29 15:11:46,094::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-782::DEBUG::2012-11-29 15:11:46,095::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-782::DEBUG::2012-11-29 15:11:46,096::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-782::DEBUG::2012-11-29 15:11:46,099::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-782::DEBUG::2012-11-29 15:11:46,101::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-782::DEBUG::2012-11-29 15:11:46,103::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-782::DEBUG::2012-11-29 15:11:46,105::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-782::DEBUG::2012-11-29 15:11:46,107::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-782::DEBUG::2012-11-29 15:11:46,109::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-782::DEBUG::2012-11-29 15:11:46,111::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-783::DEBUG::2012-11-29 15:11:47,282::task::568::TaskManager.Task::(_updateState) Task=`5c733463-0017-45a1-837e-934a3ea2e9b2`::moving from state init -> state preparing >Thread-783::INFO::2012-11-29 15:11:47,282::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-783::INFO::2012-11-29 15:11:47,282::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00214004516602', 'lastCheck': '3.5', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00258493423462', 'lastCheck': '1.3', 'code': 0, 'valid': True}} >Thread-783::DEBUG::2012-11-29 15:11:47,283::task::1151::TaskManager.Task::(prepare) Task=`5c733463-0017-45a1-837e-934a3ea2e9b2`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00214004516602', 'lastCheck': '3.5', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00258493423462', 'lastCheck': '1.3', 'code': 0, 'valid': True}} >Thread-783::DEBUG::2012-11-29 15:11:47,283::task::568::TaskManager.Task::(_updateState) Task=`5c733463-0017-45a1-837e-934a3ea2e9b2`::moving from state preparing -> state finished >Thread-783::DEBUG::2012-11-29 15:11:47,283::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-783::DEBUG::2012-11-29 15:11:47,283::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-783::DEBUG::2012-11-29 15:11:47,283::task::957::TaskManager.Task::(_decref) Task=`5c733463-0017-45a1-837e-934a3ea2e9b2`::ref 0 aborting False >Thread-782::DEBUG::2012-11-29 15:11:48,114::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-782::DEBUG::2012-11-29 15:11:48,169::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-782::DEBUG::2012-11-29 15:11:48,169::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-782::DEBUG::2012-11-29 15:11:48,169::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-782::DEBUG::2012-11-29 15:11:48,170::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-782::DEBUG::2012-11-29 15:11:48,170::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-782::DEBUG::2012-11-29 15:11:48,170::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-782::DEBUG::2012-11-29 15:11:48,170::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-782::DEBUG::2012-11-29 15:11:48,171::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-782::DEBUG::2012-11-29 15:11:48,171::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-782::DEBUG::2012-11-29 15:11:48,172::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-782::DEBUG::2012-11-29 15:11:48,326::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-782::WARNING::2012-11-29 15:11:48,326::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-782::DEBUG::2012-11-29 15:11:48,327::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-782::DEBUG::2012-11-29 15:11:48,335::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-782::DEBUG::2012-11-29 15:11:48,335::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-782::DEBUG::2012-11-29 15:11:48,339::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-782::DEBUG::2012-11-29 15:11:48,341::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-782::WARNING::2012-11-29 15:11:48,341::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_imageNS already registered >Thread-782::WARNING::2012-11-29 15:11:48,341::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS already registered >Thread-782::DEBUG::2012-11-29 15:11:48,344::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=55765701e293f1e05eb6ae04fdf4a6ac9c408767'] >Thread-782::DEBUG::2012-11-29 15:11:48,344::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-782::DEBUG::2012-11-29 15:11:48,344::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-782::DEBUG::2012-11-29 15:11:48,344::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-782::DEBUG::2012-11-29 15:11:48,345::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-782::DEBUG::2012-11-29 15:11:48,345::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-782::DEBUG::2012-11-29 15:11:48,348::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-782::WARNING::2012-11-29 15:11:48,348::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `76a4921b-744d-4d18-9b01-f1754c79020d` >Thread-782::DEBUG::2012-11-29 15:11:48,348::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-782::DEBUG::2012-11-29 15:11:48,349::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-782::DEBUG::2012-11-29 15:11:48,349::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8234598d7c23196263549de1a563f326a01a53a3'] >Thread-782::DEBUG::2012-11-29 15:11:48,352::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-782::DEBUG::2012-11-29 15:11:48,352::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-782::DEBUG::2012-11-29 15:11:48,352::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-782::DEBUG::2012-11-29 15:11:48,353::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-782::DEBUG::2012-11-29 15:11:48,353::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `76a4921b-744d-4d18-9b01-f1754c79020d` is done >Thread-782::INFO::2012-11-29 15:11:48,353::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-782::DEBUG::2012-11-29 15:11:48,353::task::1151::TaskManager.Task::(prepare) Task=`0c7c18ee-0b80-4eb7-a44b-175b1fc899e8`::finished: None >Thread-782::DEBUG::2012-11-29 15:11:48,353::task::568::TaskManager.Task::(_updateState) Task=`0c7c18ee-0b80-4eb7-a44b-175b1fc899e8`::moving from state preparing -> state finished >Thread-782::DEBUG::2012-11-29 15:11:48,354::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-782::DEBUG::2012-11-29 15:11:48,354::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-782::DEBUG::2012-11-29 15:11:48,354::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-782::DEBUG::2012-11-29 15:11:48,354::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-782::DEBUG::2012-11-29 15:11:48,355::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-782::DEBUG::2012-11-29 15:11:48,355::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-782::DEBUG::2012-11-29 15:11:48,355::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-782::DEBUG::2012-11-29 15:11:48,355::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-782::DEBUG::2012-11-29 15:11:48,355::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-782::DEBUG::2012-11-29 15:11:48,356::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-782::DEBUG::2012-11-29 15:11:48,356::task::957::TaskManager.Task::(_decref) Task=`0c7c18ee-0b80-4eb7-a44b-175b1fc899e8`::ref 0 aborting False >Thread-788::DEBUG::2012-11-29 15:11:48,415::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-788::DEBUG::2012-11-29 15:11:48,415::task::568::TaskManager.Task::(_updateState) Task=`1338cd61-aee6-4bc9-b9d7-40982ae8d27a`::moving from state init -> state preparing >Thread-788::INFO::2012-11-29 15:11:48,416::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-788::DEBUG::2012-11-29 15:11:48,416::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c5635eb2-c3c2-40d7-ab5a-ba7f419ce922`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-788::DEBUG::2012-11-29 15:11:48,416::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-788::DEBUG::2012-11-29 15:11:48,416::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-788::DEBUG::2012-11-29 15:11:48,417::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`c5635eb2-c3c2-40d7-ab5a-ba7f419ce922`::Granted request >Thread-788::DEBUG::2012-11-29 15:11:48,417::task::794::TaskManager.Task::(resourceAcquired) Task=`1338cd61-aee6-4bc9-b9d7-40982ae8d27a`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-788::DEBUG::2012-11-29 15:11:48,417::task::957::TaskManager.Task::(_decref) Task=`1338cd61-aee6-4bc9-b9d7-40982ae8d27a`::ref 1 aborting False >Thread-788::INFO::2012-11-29 15:11:48,417::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-788::DEBUG::2012-11-29 15:11:48,421::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8234598d7c23196263549de1a563f326a01a53a3'] >Thread-788::DEBUG::2012-11-29 15:11:48,421::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,421::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,422::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,422::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,422::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,422::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,423::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,424::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-788::DEBUG::2012-11-29 15:11:48,575::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-788::WARNING::2012-11-29 15:11:48,575::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-788::DEBUG::2012-11-29 15:11:48,576::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,584::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-788::DEBUG::2012-11-29 15:11:48,584::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-788::DEBUG::2012-11-29 15:11:48,587::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8234598d7c23196263549de1a563f326a01a53a3'] >Thread-788::DEBUG::2012-11-29 15:11:48,588::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-788::WARNING::2012-11-29 15:11:48,588::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-788::WARNING::2012-11-29 15:11:48,588::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-788::DEBUG::2012-11-29 15:11:48,588::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-788::DEBUG::2012-11-29 15:11:48,589::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-788::DEBUG::2012-11-29 15:11:48,589::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-788::DEBUG::2012-11-29 15:11:48,589::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-788::WARNING::2012-11-29 15:11:48,589::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-788::DEBUG::2012-11-29 15:11:48,590::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-788::DEBUG::2012-11-29 15:11:48,590::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-788::DEBUG::2012-11-29 15:11:48,741::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-788::WARNING::2012-11-29 15:11:48,742::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-788::DEBUG::2012-11-29 15:11:48,742::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-788::INFO::2012-11-29 15:11:48,748::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-788::INFO::2012-11-29 15:11:48,749::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-788::INFO::2012-11-29 15:11:48,749::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-788::INFO::2012-11-29 15:11:48,749::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-788::DEBUG::2012-11-29 15:11:48,750::task::1151::TaskManager.Task::(prepare) Task=`1338cd61-aee6-4bc9-b9d7-40982ae8d27a`::finished: None >Thread-788::DEBUG::2012-11-29 15:11:48,750::task::568::TaskManager.Task::(_updateState) Task=`1338cd61-aee6-4bc9-b9d7-40982ae8d27a`::moving from state preparing -> state finished >Thread-788::DEBUG::2012-11-29 15:11:48,750::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-788::DEBUG::2012-11-29 15:11:48,750::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-788::DEBUG::2012-11-29 15:11:48,750::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-788::DEBUG::2012-11-29 15:11:48,751::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-788::DEBUG::2012-11-29 15:11:48,751::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-788::DEBUG::2012-11-29 15:11:48,751::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-788::DEBUG::2012-11-29 15:11:48,751::task::957::TaskManager.Task::(_decref) Task=`1338cd61-aee6-4bc9-b9d7-40982ae8d27a`::ref 0 aborting False >Thread-795::DEBUG::2012-11-29 15:11:48,784::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-795::DEBUG::2012-11-29 15:11:48,784::task::568::TaskManager.Task::(_updateState) Task=`231cbdad-56ea-4627-8d0c-d33a675b22ba`::moving from state init -> state preparing >Thread-795::INFO::2012-11-29 15:11:48,784::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-795::DEBUG::2012-11-29 15:11:48,785::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-795::DEBUG::2012-11-29 15:11:48,814::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-795::DEBUG::2012-11-29 15:11:48,814::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-795::DEBUG::2012-11-29 15:11:48,814::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-795::DEBUG::2012-11-29 15:11:48,815::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-795::DEBUG::2012-11-29 15:11:48,815::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-795::DEBUG::2012-11-29 15:11:48,829::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-795::DEBUG::2012-11-29 15:11:48,829::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-795::DEBUG::2012-11-29 15:11:48,831::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-795::DEBUG::2012-11-29 15:11:48,833::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-795::DEBUG::2012-11-29 15:11:48,835::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-795::DEBUG::2012-11-29 15:11:48,837::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-795::DEBUG::2012-11-29 15:11:48,839::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-795::DEBUG::2012-11-29 15:11:48,841::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-795::DEBUG::2012-11-29 15:11:48,843::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-795::DEBUG::2012-11-29 15:11:48,845::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-795::DEBUG::2012-11-29 15:11:50,848::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-795::DEBUG::2012-11-29 15:11:50,910::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-795::DEBUG::2012-11-29 15:11:50,911::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-795::DEBUG::2012-11-29 15:11:50,911::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-795::DEBUG::2012-11-29 15:11:50,911::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-795::DEBUG::2012-11-29 15:11:50,912::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-795::DEBUG::2012-11-29 15:11:50,912::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-795::DEBUG::2012-11-29 15:11:50,912::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-795::DEBUG::2012-11-29 15:11:50,912::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-795::INFO::2012-11-29 15:11:50,913::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-795::DEBUG::2012-11-29 15:11:50,913::task::1151::TaskManager.Task::(prepare) Task=`231cbdad-56ea-4627-8d0c-d33a675b22ba`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-795::DEBUG::2012-11-29 15:11:50,913::task::568::TaskManager.Task::(_updateState) Task=`231cbdad-56ea-4627-8d0c-d33a675b22ba`::moving from state preparing -> state finished >Thread-795::DEBUG::2012-11-29 15:11:50,914::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-795::DEBUG::2012-11-29 15:11:50,914::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-795::DEBUG::2012-11-29 15:11:50,914::task::957::TaskManager.Task::(_decref) Task=`231cbdad-56ea-4627-8d0c-d33a675b22ba`::ref 0 aborting False >Thread-798::DEBUG::2012-11-29 15:11:51,693::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-798::DEBUG::2012-11-29 15:11:51,693::task::568::TaskManager.Task::(_updateState) Task=`07a96ea1-c2da-4c12-86bc-3483fe202fd2`::moving from state init -> state preparing >Thread-798::INFO::2012-11-29 15:11:51,694::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-798::INFO::2012-11-29 15:11:51,694::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-798::DEBUG::2012-11-29 15:11:51,694::task::1151::TaskManager.Task::(prepare) Task=`07a96ea1-c2da-4c12-86bc-3483fe202fd2`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-798::DEBUG::2012-11-29 15:11:51,694::task::568::TaskManager.Task::(_updateState) Task=`07a96ea1-c2da-4c12-86bc-3483fe202fd2`::moving from state preparing -> state finished >Thread-798::DEBUG::2012-11-29 15:11:51,694::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-798::DEBUG::2012-11-29 15:11:51,694::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-798::DEBUG::2012-11-29 15:11:51,695::task::957::TaskManager.Task::(_decref) Task=`07a96ea1-c2da-4c12-86bc-3483fe202fd2`::ref 0 aborting False >Thread-799::DEBUG::2012-11-29 15:11:51,722::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-799::DEBUG::2012-11-29 15:11:51,723::task::568::TaskManager.Task::(_updateState) Task=`1be192db-2776-4d80-95d0-2a05bd116b95`::moving from state init -> state preparing >Thread-799::INFO::2012-11-29 15:11:51,723::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-799::DEBUG::2012-11-29 15:11:51,725::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-799::INFO::2012-11-29 15:11:51,751::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-799::DEBUG::2012-11-29 15:11:51,751::task::1151::TaskManager.Task::(prepare) Task=`1be192db-2776-4d80-95d0-2a05bd116b95`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-799::DEBUG::2012-11-29 15:11:51,751::task::568::TaskManager.Task::(_updateState) Task=`1be192db-2776-4d80-95d0-2a05bd116b95`::moving from state preparing -> state finished >Thread-799::DEBUG::2012-11-29 15:11:51,751::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-799::DEBUG::2012-11-29 15:11:51,751::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-799::DEBUG::2012-11-29 15:11:51,752::task::957::TaskManager.Task::(_decref) Task=`1be192db-2776-4d80-95d0-2a05bd116b95`::ref 0 aborting False >Thread-800::DEBUG::2012-11-29 15:11:51,780::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-800::DEBUG::2012-11-29 15:11:51,781::task::568::TaskManager.Task::(_updateState) Task=`4fe71e7c-0e0b-4ec3-848a-74720b5d036c`::moving from state init -> state preparing >Thread-800::INFO::2012-11-29 15:11:51,781::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='76a4921b-744d-4d18-9b01-f1754c79020d', autoDetach=False, options=None) >Thread-800::DEBUG::2012-11-29 15:11:51,781::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-800::DEBUG::2012-11-29 15:11:51,782::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-800::DEBUG::2012-11-29 15:11:51,782::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-800::DEBUG::2012-11-29 15:11:51,797::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-800::DEBUG::2012-11-29 15:11:51,797::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:51,799::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:51,801::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:51,803::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:51,805::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:51,808::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:51,810::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:51,812::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:51,814::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-800::DEBUG::2012-11-29 15:11:53,817::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-800::DEBUG::2012-11-29 15:11:53,866::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-800::DEBUG::2012-11-29 15:11:53,867::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`2ed11c5a-9a8f-45b4-99ce-8c2292b9ad6a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-800::DEBUG::2012-11-29 15:11:53,867::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' for lock type 'exclusive' >Thread-800::DEBUG::2012-11-29 15:11:53,867::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free. Now locking as 'exclusive' (1 active user) >Thread-800::DEBUG::2012-11-29 15:11:53,868::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.76a4921b-744d-4d18-9b01-f1754c79020d`ReqID=`2ed11c5a-9a8f-45b4-99ce-8c2292b9ad6a`::Granted request >Thread-800::DEBUG::2012-11-29 15:11:53,868::task::794::TaskManager.Task::(resourceAcquired) Task=`4fe71e7c-0e0b-4ec3-848a-74720b5d036c`::_resourcesAcquired: Storage.76a4921b-744d-4d18-9b01-f1754c79020d (exclusive) >Thread-800::DEBUG::2012-11-29 15:11:53,869::task::957::TaskManager.Task::(_decref) Task=`4fe71e7c-0e0b-4ec3-848a-74720b5d036c`::ref 1 aborting False >Thread-800::DEBUG::2012-11-29 15:11:53,869::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-800::DEBUG::2012-11-29 15:11:53,869::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-800::DEBUG::2012-11-29 15:11:53,869::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-800::DEBUG::2012-11-29 15:11:53,870::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-800::DEBUG::2012-11-29 15:11:53,870::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-800::DEBUG::2012-11-29 15:11:53,884::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-800::DEBUG::2012-11-29 15:11:53,885::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:53,886::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:53,888::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:53,890::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:53,893::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:53,895::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:53,897::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:53,899::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-800::DEBUG::2012-11-29 15:11:53,901::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-800::DEBUG::2012-11-29 15:11:55,904::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-800::DEBUG::2012-11-29 15:11:55,968::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-800::DEBUG::2012-11-29 15:11:55,969::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-800::DEBUG::2012-11-29 15:11:55,969::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-800::DEBUG::2012-11-29 15:11:55,969::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-800::DEBUG::2012-11-29 15:11:55,970::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-800::DEBUG::2012-11-29 15:11:55,970::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-800::DEBUG::2012-11-29 15:11:55,970::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-800::DEBUG::2012-11-29 15:11:55,970::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-800::DEBUG::2012-11-29 15:11:55,971::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-800::DEBUG::2012-11-29 15:11:55,971::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-672::DEBUG::2012-11-29 15:11:56,030::lvm::368::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-672::DEBUG::2012-11-29 15:11:56,031::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-803::DEBUG::2012-11-29 15:11:56,078::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-803::DEBUG::2012-11-29 15:11:56,078::task::568::TaskManager.Task::(_updateState) Task=`fc061292-78d8-4b9f-8998-66ddb267b569`::moving from state init -> state preparing >Thread-803::INFO::2012-11-29 15:11:56,079::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-803::INFO::2012-11-29 15:11:56,079::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-803::DEBUG::2012-11-29 15:11:56,079::task::1151::TaskManager.Task::(prepare) Task=`fc061292-78d8-4b9f-8998-66ddb267b569`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-803::DEBUG::2012-11-29 15:11:56,079::task::568::TaskManager.Task::(_updateState) Task=`fc061292-78d8-4b9f-8998-66ddb267b569`::moving from state preparing -> state finished >Thread-803::DEBUG::2012-11-29 15:11:56,080::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-803::DEBUG::2012-11-29 15:11:56,080::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-803::DEBUG::2012-11-29 15:11:56,080::task::957::TaskManager.Task::(_decref) Task=`fc061292-78d8-4b9f-8998-66ddb267b569`::ref 0 aborting False >Thread-804::DEBUG::2012-11-29 15:11:56,105::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-804::DEBUG::2012-11-29 15:11:56,106::task::568::TaskManager.Task::(_updateState) Task=`4e75cb84-30b4-4e35-9e3b-3de7abf7b5db`::moving from state init -> state preparing >Thread-804::INFO::2012-11-29 15:11:56,106::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-804::DEBUG::2012-11-29 15:11:56,107::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`77bcff29-be72-4558-8fa0-7779cd7d2708`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-804::DEBUG::2012-11-29 15:11:56,107::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-804::DEBUG::2012-11-29 15:11:56,107::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-804::DEBUG::2012-11-29 15:11:56,107::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`77bcff29-be72-4558-8fa0-7779cd7d2708`::Granted request >Thread-804::DEBUG::2012-11-29 15:11:56,108::task::794::TaskManager.Task::(resourceAcquired) Task=`4e75cb84-30b4-4e35-9e3b-3de7abf7b5db`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-804::DEBUG::2012-11-29 15:11:56,108::task::957::TaskManager.Task::(_decref) Task=`4e75cb84-30b4-4e35-9e3b-3de7abf7b5db`::ref 1 aborting False >Thread-800::DEBUG::2012-11-29 15:11:56,125::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-800::WARNING::2012-11-29 15:11:56,126::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-800::DEBUG::2012-11-29 15:11:56,135::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-800::DEBUG::2012-11-29 15:11:56,135::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-800::DEBUG::2012-11-29 15:11:56,139::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-800::DEBUG::2012-11-29 15:11:56,142::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-800::WARNING::2012-11-29 15:11:56,143::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_imageNS already registered >Thread-800::WARNING::2012-11-29 15:11:56,144::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS already registered >Thread-800::DEBUG::2012-11-29 15:11:56,147::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-800::DEBUG::2012-11-29 15:11:56,149::lvm::368::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-800::DEBUG::2012-11-29 15:11:56,150::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 76a4921b-744d-4d18-9b01-f1754c79020d' (cwd None) >Thread-672::DEBUG::2012-11-29 15:11:56,190::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-672::WARNING::2012-11-29 15:11:56,190::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-672::DEBUG::2012-11-29 15:11:56,202::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-672::DEBUG::2012-11-29 15:11:56,202::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-672::DEBUG::2012-11-29 15:11:56,205::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9b0b5035d83a6ecb376ae2792c24d6f80f9f8e83'] >Thread-672::DEBUG::2012-11-29 15:11:56,208::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-672::WARNING::2012-11-29 15:11:56,209::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_imageNS already registered >Thread-672::WARNING::2012-11-29 15:11:56,209::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_volumeNS already registered >Thread-804::INFO::2012-11-29 15:11:56,210::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '860959539200', 'alerts': [], 'disktotal': '860961636352'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Active', 'diskfree': '860959539200', 'alerts': [], 'disktotal': '860961636352'}}} >Thread-804::DEBUG::2012-11-29 15:11:56,211::task::1151::TaskManager.Task::(prepare) Task=`4e75cb84-30b4-4e35-9e3b-3de7abf7b5db`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '860959539200', 'alerts': [], 'disktotal': '860961636352'}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'status': 'Active', 'diskfree': '860959539200', 'alerts': [], 'disktotal': '860961636352'}}} >Thread-804::DEBUG::2012-11-29 15:11:56,213::task::568::TaskManager.Task::(_updateState) Task=`4e75cb84-30b4-4e35-9e3b-3de7abf7b5db`::moving from state preparing -> state finished >Thread-804::DEBUG::2012-11-29 15:11:56,214::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-804::DEBUG::2012-11-29 15:11:56,215::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-804::DEBUG::2012-11-29 15:11:56,217::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-804::DEBUG::2012-11-29 15:11:56,219::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-804::DEBUG::2012-11-29 15:11:56,221::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-804::DEBUG::2012-11-29 15:11:56,222::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-804::DEBUG::2012-11-29 15:11:56,223::task::957::TaskManager.Task::(_decref) Task=`4e75cb84-30b4-4e35-9e3b-3de7abf7b5db`::ref 0 aborting False >Thread-800::DEBUG::2012-11-29 15:11:56,305::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found\n'; <rc> = 5 >Thread-800::WARNING::2012-11-29 15:11:56,306::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "76a4921b-744d-4d18-9b01-f1754c79020d" not found'] >Thread-800::DEBUG::2012-11-29 15:11:56,306::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-800::DEBUG::2012-11-29 15:11:56,313::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529/76a4921b-744d-4d18-9b01-f1754c79020d >Thread-800::DEBUG::2012-11-29 15:11:56,313::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-800::DEBUG::2012-11-29 15:11:56,316::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=ExportDomainRest', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'ROLE=Regular', 'SDUUID=76a4921b-744d-4d18-9b01-f1754c79020d', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c2ecd0c16f153b08f4bec504eaef1f95d40821f8'] >Thread-800::DEBUG::2012-11-29 15:11:56,318::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-800::WARNING::2012-11-29 15:11:56,318::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_imageNS already registered >Thread-800::WARNING::2012-11-29 15:11:56,318::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 76a4921b-744d-4d18-9b01-f1754c79020d_volumeNS already registered >Thread-800::INFO::2012-11-29 15:11:56,318::fileSD::404::Storage.StorageDomain::(format) Formatting domain 76a4921b-744d-4d18-9b01-f1754c79020d >Thread-800::INFO::2012-11-29 15:11:56,335::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-800::DEBUG::2012-11-29 15:11:56,335::task::1151::TaskManager.Task::(prepare) Task=`4fe71e7c-0e0b-4ec3-848a-74720b5d036c`::finished: None >Thread-800::DEBUG::2012-11-29 15:11:56,335::task::568::TaskManager.Task::(_updateState) Task=`4fe71e7c-0e0b-4ec3-848a-74720b5d036c`::moving from state preparing -> state finished >Thread-800::DEBUG::2012-11-29 15:11:56,335::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.76a4921b-744d-4d18-9b01-f1754c79020d': < ResourceRef 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', isValid: 'True' obj: 'None'>} >Thread-800::DEBUG::2012-11-29 15:11:56,336::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-800::DEBUG::2012-11-29 15:11:56,336::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' >Thread-800::DEBUG::2012-11-29 15:11:56,336::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' (0 active users) >Thread-800::DEBUG::2012-11-29 15:11:56,336::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d' is free, finding out if anyone is waiting for it. >Thread-800::DEBUG::2012-11-29 15:11:56,336::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.76a4921b-744d-4d18-9b01-f1754c79020d', Clearing records. >Thread-800::DEBUG::2012-11-29 15:11:56,337::task::957::TaskManager.Task::(_decref) Task=`4fe71e7c-0e0b-4ec3-848a-74720b5d036c`::ref 0 aborting False >Thread-817::DEBUG::2012-11-29 15:11:56,368::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-817::DEBUG::2012-11-29 15:11:56,368::task::568::TaskManager.Task::(_updateState) Task=`21ec952c-0873-4108-8a8f-78baa671a432`::moving from state init -> state preparing >Thread-817::INFO::2012-11-29 15:11:56,368::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_2012112914572687529', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8', 'port': ''}], options=None) >Thread-817::DEBUG::2012-11-29 15:11:56,369::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__2012112914572687529' (cwd None) >Thread-817::DEBUG::2012-11-29 15:11:56,398::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-817::DEBUG::2012-11-29 15:11:56,398::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-817::DEBUG::2012-11-29 15:11:56,398::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-817::DEBUG::2012-11-29 15:11:56,399::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-817::DEBUG::2012-11-29 15:11:56,399::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-817::DEBUG::2012-11-29 15:11:56,412::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-817::DEBUG::2012-11-29 15:11:56,413::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-817::DEBUG::2012-11-29 15:11:56,414::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2012-11-29 15:11:56,417::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2012-11-29 15:11:56,419::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2012-11-29 15:11:56,421::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2012-11-29 15:11:56,423::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2012-11-29 15:11:56,425::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2012-11-29 15:11:56,427::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-817::DEBUG::2012-11-29 15:11:56,429::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-818::DEBUG::2012-11-29 15:11:57,493::task::568::TaskManager.Task::(_updateState) Task=`92cb79eb-336f-46c7-8658-dbd25e7189d0`::moving from state init -> state preparing >Thread-818::INFO::2012-11-29 15:11:57,494::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-818::INFO::2012-11-29 15:11:57,494::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00250005722046', 'lastCheck': '3.7', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00256013870239', 'lastCheck': '1.3', 'code': 0, 'valid': True}} >Thread-818::DEBUG::2012-11-29 15:11:57,494::task::1151::TaskManager.Task::(prepare) Task=`92cb79eb-336f-46c7-8658-dbd25e7189d0`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00250005722046', 'lastCheck': '3.7', 'code': 0, 'valid': True}, 'c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': {'delay': '0.00256013870239', 'lastCheck': '1.3', 'code': 0, 'valid': True}} >Thread-818::DEBUG::2012-11-29 15:11:57,494::task::568::TaskManager.Task::(_updateState) Task=`92cb79eb-336f-46c7-8658-dbd25e7189d0`::moving from state preparing -> state finished >Thread-818::DEBUG::2012-11-29 15:11:57,494::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-818::DEBUG::2012-11-29 15:11:57,495::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-818::DEBUG::2012-11-29 15:11:57,495::task::957::TaskManager.Task::(_decref) Task=`92cb79eb-336f-46c7-8658-dbd25e7189d0`::ref 0 aborting False >Thread-817::DEBUG::2012-11-29 15:11:58,432::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-817::DEBUG::2012-11-29 15:11:58,486::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-817::DEBUG::2012-11-29 15:11:58,486::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-817::DEBUG::2012-11-29 15:11:58,487::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-817::DEBUG::2012-11-29 15:11:58,487::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-817::DEBUG::2012-11-29 15:11:58,487::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-817::DEBUG::2012-11-29 15:11:58,488::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-817::DEBUG::2012-11-29 15:11:58,488::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-817::DEBUG::2012-11-29 15:11:58,488::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-817::INFO::2012-11-29 15:11:58,489::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-817::DEBUG::2012-11-29 15:11:58,489::task::1151::TaskManager.Task::(prepare) Task=`21ec952c-0873-4108-8a8f-78baa671a432`::finished: {'statuslist': [{'status': 0, 'id': '6f081112-a7e6-4589-b173-d22b61b74fa8'}]} >Thread-817::DEBUG::2012-11-29 15:11:58,489::task::568::TaskManager.Task::(_updateState) Task=`21ec952c-0873-4108-8a8f-78baa671a432`::moving from state preparing -> state finished >Thread-817::DEBUG::2012-11-29 15:11:58,489::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-817::DEBUG::2012-11-29 15:11:58,490::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-817::DEBUG::2012-11-29 15:11:58,490::task::957::TaskManager.Task::(_decref) Task=`21ec952c-0873-4108-8a8f-78baa671a432`::ref 0 aborting False >Thread-820::DEBUG::2012-11-29 15:11:59,452::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-820::DEBUG::2012-11-29 15:11:59,452::task::568::TaskManager.Task::(_updateState) Task=`40104aa6-8a6d-4a3b-bf31-ab48809d2042`::moving from state init -> state preparing >Thread-820::INFO::2012-11-29 15:11:59,453::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-820::DEBUG::2012-11-29 15:11:59,453::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`f7fccf54-f100-48a8-876f-2e4936c6ff10`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-820::DEBUG::2012-11-29 15:11:59,453::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-820::DEBUG::2012-11-29 15:11:59,454::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-820::DEBUG::2012-11-29 15:11:59,454::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`f7fccf54-f100-48a8-876f-2e4936c6ff10`::Granted request >Thread-820::DEBUG::2012-11-29 15:11:59,454::task::794::TaskManager.Task::(resourceAcquired) Task=`40104aa6-8a6d-4a3b-bf31-ab48809d2042`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-820::DEBUG::2012-11-29 15:11:59,454::task::957::TaskManager.Task::(_decref) Task=`40104aa6-8a6d-4a3b-bf31-ab48809d2042`::ref 1 aborting False >Thread-820::DEBUG::2012-11-29 15:11:59,455::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`a3a83ab7-1bce-4f9b-ba63-78d7ef6cc3fd`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-820::DEBUG::2012-11-29 15:11:59,455::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' for lock type 'exclusive' >Thread-820::DEBUG::2012-11-29 15:11:59,455::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free. Now locking as 'exclusive' (1 active user) >Thread-820::DEBUG::2012-11-29 15:11:59,455::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`a3a83ab7-1bce-4f9b-ba63-78d7ef6cc3fd`::Granted request >Thread-820::DEBUG::2012-11-29 15:11:59,456::task::794::TaskManager.Task::(resourceAcquired) Task=`40104aa6-8a6d-4a3b-bf31-ab48809d2042`::_resourcesAcquired: Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (exclusive) >Thread-820::DEBUG::2012-11-29 15:11:59,456::task::957::TaskManager.Task::(_decref) Task=`40104aa6-8a6d-4a3b-bf31-ab48809d2042`::ref 1 aborting False >Thread-820::INFO::2012-11-29 15:11:59,456::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-820::DEBUG::2012-11-29 15:11:59,459::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-820::DEBUG::2012-11-29 15:11:59,459::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-820::DEBUG::2012-11-29 15:11:59,459::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ca71119e4b65a61afde83831baee218741554aaa'] >Thread-820::DEBUG::2012-11-29 15:11:59,463::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-820::DEBUG::2012-11-29 15:11:59,463::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-820::DEBUG::2012-11-29 15:11:59,463::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-672::DEBUG::2012-11-29 15:11:59,464::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-672::INFO::2012-11-29 15:11:59,464::safelease::183::SANLock::(releaseHostId) Releasing host id for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (id: 1) >Thread-672::DEBUG::2012-11-29 15:12:01,470::safelease::193::SANLock::(releaseHostId) Host id for domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 released successfully (id: 1) >Thread-820::DEBUG::2012-11-29 15:12:01,470::sp::1558::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` stopped monitoring domain `c23cb5a0-b4c5-46c1-9bc1-b49800b4de76` >Thread-820::DEBUG::2012-11-29 15:12:01,470::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-820::INFO::2012-11-29 15:12:01,471::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-820::DEBUG::2012-11-29 15:12:01,471::task::1151::TaskManager.Task::(prepare) Task=`40104aa6-8a6d-4a3b-bf31-ab48809d2042`::finished: None >Thread-820::DEBUG::2012-11-29 15:12:01,471::task::568::TaskManager.Task::(_updateState) Task=`40104aa6-8a6d-4a3b-bf31-ab48809d2042`::moving from state preparing -> state finished >Thread-820::DEBUG::2012-11-29 15:12:01,471::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': < ResourceRef 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', isValid: 'True' obj: 'None'>, 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-820::DEBUG::2012-11-29 15:12:01,471::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-820::DEBUG::2012-11-29 15:12:01,471::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' >Thread-820::DEBUG::2012-11-29 15:12:01,472::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (0 active users) >Thread-820::DEBUG::2012-11-29 15:12:01,472::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free, finding out if anyone is waiting for it. >Thread-820::DEBUG::2012-11-29 15:12:01,472::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', Clearing records. >Thread-820::DEBUG::2012-11-29 15:12:01,472::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-820::DEBUG::2012-11-29 15:12:01,472::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-820::DEBUG::2012-11-29 15:12:01,473::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-820::DEBUG::2012-11-29 15:12:01,473::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-820::DEBUG::2012-11-29 15:12:01,473::task::957::TaskManager.Task::(_decref) Task=`40104aa6-8a6d-4a3b-bf31-ab48809d2042`::ref 0 aborting False >Thread-822::DEBUG::2012-11-29 15:12:01,525::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-822::DEBUG::2012-11-29 15:12:01,526::task::568::TaskManager.Task::(_updateState) Task=`3884e4c2-cba0-43fc-a796-a02b1156618f`::moving from state init -> state preparing >Thread-822::INFO::2012-11-29 15:12:01,526::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-822::DEBUG::2012-11-29 15:12:01,526::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`41e6550a-dfab-4a59-867e-fe4d0922defb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-822::DEBUG::2012-11-29 15:12:01,526::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-822::DEBUG::2012-11-29 15:12:01,527::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-822::DEBUG::2012-11-29 15:12:01,527::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`41e6550a-dfab-4a59-867e-fe4d0922defb`::Granted request >Thread-822::DEBUG::2012-11-29 15:12:01,527::task::794::TaskManager.Task::(resourceAcquired) Task=`3884e4c2-cba0-43fc-a796-a02b1156618f`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-822::DEBUG::2012-11-29 15:12:01,527::task::957::TaskManager.Task::(_decref) Task=`3884e4c2-cba0-43fc-a796-a02b1156618f`::ref 1 aborting False >Thread-822::INFO::2012-11-29 15:12:01,528::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-822::DEBUG::2012-11-29 15:12:01,531::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ca71119e4b65a61afde83831baee218741554aaa'] >Thread-822::DEBUG::2012-11-29 15:12:01,531::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,531::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,532::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,532::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,532::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,532::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,533::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,533::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-822::DEBUG::2012-11-29 15:12:01,690::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-822::WARNING::2012-11-29 15:12:01,690::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-822::DEBUG::2012-11-29 15:12:01,691::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,697::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-822::DEBUG::2012-11-29 15:12:01,697::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-822::DEBUG::2012-11-29 15:12:01,700::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active,c23cb5a0-b4c5-46c1-9bc1-b49800b4de76:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ca71119e4b65a61afde83831baee218741554aaa'] >Thread-822::DEBUG::2012-11-29 15:12:01,701::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-822::WARNING::2012-11-29 15:12:01,701::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-822::WARNING::2012-11-29 15:12:01,702::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-822::DEBUG::2012-11-29 15:12:01,702::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-822::DEBUG::2012-11-29 15:12:01,702::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-822::DEBUG::2012-11-29 15:12:01,702::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-822::DEBUG::2012-11-29 15:12:01,703::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-822::WARNING::2012-11-29 15:12:01,703::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-822::DEBUG::2012-11-29 15:12:01,703::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-822::DEBUG::2012-11-29 15:12:01,704::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-822::DEBUG::2012-11-29 15:12:01,847::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-822::DEBUG::2012-11-29 15:12:01,847::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-822::INFO::2012-11-29 15:12:01,852::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-822::INFO::2012-11-29 15:12:01,852::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-822::INFO::2012-11-29 15:12:01,853::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-822::DEBUG::2012-11-29 15:12:01,853::task::1151::TaskManager.Task::(prepare) Task=`3884e4c2-cba0-43fc-a796-a02b1156618f`::finished: None >Thread-822::DEBUG::2012-11-29 15:12:01,853::task::568::TaskManager.Task::(_updateState) Task=`3884e4c2-cba0-43fc-a796-a02b1156618f`::moving from state preparing -> state finished >Thread-822::DEBUG::2012-11-29 15:12:01,853::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-822::DEBUG::2012-11-29 15:12:01,854::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-822::DEBUG::2012-11-29 15:12:01,854::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-822::DEBUG::2012-11-29 15:12:01,854::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-822::DEBUG::2012-11-29 15:12:01,854::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-822::DEBUG::2012-11-29 15:12:01,854::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-822::DEBUG::2012-11-29 15:12:01,855::task::957::TaskManager.Task::(_decref) Task=`3884e4c2-cba0-43fc-a796-a02b1156618f`::ref 0 aborting False >Thread-828::DEBUG::2012-11-29 15:12:01,889::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-828::DEBUG::2012-11-29 15:12:01,889::task::568::TaskManager.Task::(_updateState) Task=`6f90c3a9-90ba-498a-86ea-4c54a36cc3b6`::moving from state init -> state preparing >Thread-828::INFO::2012-11-29 15:12:01,889::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-828::DEBUG::2012-11-29 15:12:01,890::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865' (cwd None) >Thread-828::DEBUG::2012-11-29 15:12:01,914::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-828::DEBUG::2012-11-29 15:12:01,915::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-828::DEBUG::2012-11-29 15:12:01,915::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-828::DEBUG::2012-11-29 15:12:01,915::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-828::DEBUG::2012-11-29 15:12:01,915::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-828::DEBUG::2012-11-29 15:12:01,930::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-828::DEBUG::2012-11-29 15:12:01,930::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-828::DEBUG::2012-11-29 15:12:01,932::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-828::DEBUG::2012-11-29 15:12:01,934::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-828::DEBUG::2012-11-29 15:12:01,936::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-828::DEBUG::2012-11-29 15:12:01,938::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-828::DEBUG::2012-11-29 15:12:01,940::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-828::DEBUG::2012-11-29 15:12:01,942::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-828::DEBUG::2012-11-29 15:12:01,944::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-828::DEBUG::2012-11-29 15:12:01,946::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-828::DEBUG::2012-11-29 15:12:03,949::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-828::DEBUG::2012-11-29 15:12:03,999::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-828::DEBUG::2012-11-29 15:12:03,999::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-828::DEBUG::2012-11-29 15:12:04,000::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-828::DEBUG::2012-11-29 15:12:04,000::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-828::DEBUG::2012-11-29 15:12:04,000::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-828::DEBUG::2012-11-29 15:12:04,001::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-828::DEBUG::2012-11-29 15:12:04,001::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-828::DEBUG::2012-11-29 15:12:04,001::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-828::INFO::2012-11-29 15:12:04,002::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-828::DEBUG::2012-11-29 15:12:04,002::task::1151::TaskManager.Task::(prepare) Task=`6f90c3a9-90ba-498a-86ea-4c54a36cc3b6`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-828::DEBUG::2012-11-29 15:12:04,002::task::568::TaskManager.Task::(_updateState) Task=`6f90c3a9-90ba-498a-86ea-4c54a36cc3b6`::moving from state preparing -> state finished >Thread-828::DEBUG::2012-11-29 15:12:04,002::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-828::DEBUG::2012-11-29 15:12:04,003::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-828::DEBUG::2012-11-29 15:12:04,003::task::957::TaskManager.Task::(_decref) Task=`6f90c3a9-90ba-498a-86ea-4c54a36cc3b6`::ref 0 aborting False >Thread-830::DEBUG::2012-11-29 15:12:05,343::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-830::DEBUG::2012-11-29 15:12:05,343::task::568::TaskManager.Task::(_updateState) Task=`55c0d2a6-e8ee-4ee3-89ef-40b40e59a5e3`::moving from state init -> state preparing >Thread-830::INFO::2012-11-29 15:12:05,344::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-830::INFO::2012-11-29 15:12:05,344::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-830::DEBUG::2012-11-29 15:12:05,344::task::1151::TaskManager.Task::(prepare) Task=`55c0d2a6-e8ee-4ee3-89ef-40b40e59a5e3`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-830::DEBUG::2012-11-29 15:12:05,344::task::568::TaskManager.Task::(_updateState) Task=`55c0d2a6-e8ee-4ee3-89ef-40b40e59a5e3`::moving from state preparing -> state finished >Thread-830::DEBUG::2012-11-29 15:12:05,344::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-830::DEBUG::2012-11-29 15:12:05,345::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-830::DEBUG::2012-11-29 15:12:05,345::task::957::TaskManager.Task::(_decref) Task=`55c0d2a6-e8ee-4ee3-89ef-40b40e59a5e3`::ref 0 aborting False >Thread-831::DEBUG::2012-11-29 15:12:05,373::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-831::DEBUG::2012-11-29 15:12:05,373::task::568::TaskManager.Task::(_updateState) Task=`c3a84944-838d-4d97-accb-b4189b6bfd5c`::moving from state init -> state preparing >Thread-831::INFO::2012-11-29 15:12:05,374::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-831::DEBUG::2012-11-29 15:12:05,376::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865' (cwd None) >Thread-831::INFO::2012-11-29 15:12:05,405::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-831::DEBUG::2012-11-29 15:12:05,406::task::1151::TaskManager.Task::(prepare) Task=`c3a84944-838d-4d97-accb-b4189b6bfd5c`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-831::DEBUG::2012-11-29 15:12:05,406::task::568::TaskManager.Task::(_updateState) Task=`c3a84944-838d-4d97-accb-b4189b6bfd5c`::moving from state preparing -> state finished >Thread-831::DEBUG::2012-11-29 15:12:05,406::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-831::DEBUG::2012-11-29 15:12:05,406::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-831::DEBUG::2012-11-29 15:12:05,407::task::957::TaskManager.Task::(_decref) Task=`c3a84944-838d-4d97-accb-b4189b6bfd5c`::ref 0 aborting False >Thread-832::DEBUG::2012-11-29 15:12:05,436::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-832::DEBUG::2012-11-29 15:12:05,437::task::568::TaskManager.Task::(_updateState) Task=`2e631e59-b10d-4268-b664-d57fdef7ede5`::moving from state init -> state preparing >Thread-832::INFO::2012-11-29 15:12:05,437::logUtils::37::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-832::DEBUG::2012-11-29 15:12:05,438::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`3979f385-17ce-4681-a735-f7866e4f79cb`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-832::DEBUG::2012-11-29 15:12:05,438::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-832::DEBUG::2012-11-29 15:12:05,438::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-832::DEBUG::2012-11-29 15:12:05,438::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`3979f385-17ce-4681-a735-f7866e4f79cb`::Granted request >Thread-832::DEBUG::2012-11-29 15:12:05,439::task::794::TaskManager.Task::(resourceAcquired) Task=`2e631e59-b10d-4268-b664-d57fdef7ede5`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-832::DEBUG::2012-11-29 15:12:05,439::task::957::TaskManager.Task::(_decref) Task=`2e631e59-b10d-4268-b664-d57fdef7ede5`::ref 1 aborting False >Thread-832::DEBUG::2012-11-29 15:12:05,439::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`deea20ed-3a27-4179-b219-6a02b8f731a7`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-832::DEBUG::2012-11-29 15:12:05,439::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' for lock type 'exclusive' >Thread-832::DEBUG::2012-11-29 15:12:05,440::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free. Now locking as 'exclusive' (1 active user) >Thread-832::DEBUG::2012-11-29 15:12:05,440::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`deea20ed-3a27-4179-b219-6a02b8f731a7`::Granted request >Thread-832::DEBUG::2012-11-29 15:12:05,440::task::794::TaskManager.Task::(resourceAcquired) Task=`2e631e59-b10d-4268-b664-d57fdef7ede5`::_resourcesAcquired: Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (exclusive) >Thread-832::DEBUG::2012-11-29 15:12:05,440::task::957::TaskManager.Task::(_decref) Task=`2e631e59-b10d-4268-b664-d57fdef7ede5`::ref 1 aborting False >Thread-832::INFO::2012-11-29 15:12:05,441::sp::984::Storage.StoragePool::(detachSD) sdUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-832::DEBUG::2012-11-29 15:12:05,441::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-832::DEBUG::2012-11-29 15:12:05,441::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-832::DEBUG::2012-11-29 15:12:05,441::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-832::DEBUG::2012-11-29 15:12:05,441::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-832::DEBUG::2012-11-29 15:12:05,442::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-832::DEBUG::2012-11-29 15:12:05,455::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-832::DEBUG::2012-11-29 15:12:05,455::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-832::DEBUG::2012-11-29 15:12:05,457::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-832::DEBUG::2012-11-29 15:12:05,460::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-832::DEBUG::2012-11-29 15:12:05,462::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-832::DEBUG::2012-11-29 15:12:05,464::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-832::DEBUG::2012-11-29 15:12:05,466::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-832::DEBUG::2012-11-29 15:12:05,468::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-832::DEBUG::2012-11-29 15:12:05,470::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-832::DEBUG::2012-11-29 15:12:05,472::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-832::DEBUG::2012-11-29 15:12:07,475::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-832::DEBUG::2012-11-29 15:12:07,523::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-832::DEBUG::2012-11-29 15:12:07,523::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-832::DEBUG::2012-11-29 15:12:07,524::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-832::DEBUG::2012-11-29 15:12:07,524::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-832::DEBUG::2012-11-29 15:12:07,524::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-832::DEBUG::2012-11-29 15:12:07,525::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-832::DEBUG::2012-11-29 15:12:07,525::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-832::DEBUG::2012-11-29 15:12:07,525::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-832::DEBUG::2012-11-29 15:12:07,526::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-832::DEBUG::2012-11-29 15:12:07,527::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-832::DEBUG::2012-11-29 15:12:07,691::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-834::DEBUG::2012-11-29 15:12:07,692::task::568::TaskManager.Task::(_updateState) Task=`c32a5f33-7690-4408-88d4-e08be3cdb922`::moving from state init -> state preparing >Thread-834::INFO::2012-11-29 15:12:07,694::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-832::WARNING::2012-11-29 15:12:07,695::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-834::INFO::2012-11-29 15:12:07,696::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00221085548401', 'lastCheck': '3.9', 'code': 0, 'valid': True}} >Thread-834::DEBUG::2012-11-29 15:12:07,697::task::1151::TaskManager.Task::(prepare) Task=`c32a5f33-7690-4408-88d4-e08be3cdb922`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00221085548401', 'lastCheck': '3.9', 'code': 0, 'valid': True}} >Thread-832::DEBUG::2012-11-29 15:12:07,698::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-834::DEBUG::2012-11-29 15:12:07,699::task::568::TaskManager.Task::(_updateState) Task=`c32a5f33-7690-4408-88d4-e08be3cdb922`::moving from state preparing -> state finished >Thread-834::DEBUG::2012-11-29 15:12:07,701::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-834::DEBUG::2012-11-29 15:12:07,703::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-834::DEBUG::2012-11-29 15:12:07,705::task::957::TaskManager.Task::(_decref) Task=`c32a5f33-7690-4408-88d4-e08be3cdb922`::ref 0 aborting False >Thread-832::DEBUG::2012-11-29 15:12:07,726::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-832::DEBUG::2012-11-29 15:12:07,727::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-832::DEBUG::2012-11-29 15:12:07,730::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9b0b5035d83a6ecb376ae2792c24d6f80f9f8e83'] >Thread-832::DEBUG::2012-11-29 15:12:07,732::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-832::WARNING::2012-11-29 15:12:07,732::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_imageNS already registered >Thread-832::WARNING::2012-11-29 15:12:07,732::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_volumeNS already registered >Thread-832::DEBUG::2012-11-29 15:12:07,736::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=9b0b5035d83a6ecb376ae2792c24d6f80f9f8e83'] >Thread-832::DEBUG::2012-11-29 15:12:07,736::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-832::DEBUG::2012-11-29 15:12:07,736::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-832::DEBUG::2012-11-29 15:12:07,737::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-832::DEBUG::2012-11-29 15:12:07,737::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-832::DEBUG::2012-11-29 15:12:07,737::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=35a3bdebda2a8dcbf11e261e054b10045c044fef'] >Thread-832::DEBUG::2012-11-29 15:12:07,740::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-832::WARNING::2012-11-29 15:12:07,741::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `c23cb5a0-b4c5-46c1-9bc1-b49800b4de76` >Thread-832::DEBUG::2012-11-29 15:12:07,741::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-832::DEBUG::2012-11-29 15:12:07,741::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-832::DEBUG::2012-11-29 15:12:07,741::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5d93bd966b3139ba2a97b71863479fd1506d2da7'] >Thread-832::DEBUG::2012-11-29 15:12:07,745::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-832::DEBUG::2012-11-29 15:12:07,745::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-832::DEBUG::2012-11-29 15:12:07,745::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-832::DEBUG::2012-11-29 15:12:07,746::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-832::DEBUG::2012-11-29 15:12:07,746::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `c23cb5a0-b4c5-46c1-9bc1-b49800b4de76` is done >Thread-832::INFO::2012-11-29 15:12:07,746::logUtils::39::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-832::DEBUG::2012-11-29 15:12:07,746::task::1151::TaskManager.Task::(prepare) Task=`2e631e59-b10d-4268-b664-d57fdef7ede5`::finished: None >Thread-832::DEBUG::2012-11-29 15:12:07,746::task::568::TaskManager.Task::(_updateState) Task=`2e631e59-b10d-4268-b664-d57fdef7ede5`::moving from state preparing -> state finished >Thread-832::DEBUG::2012-11-29 15:12:07,746::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': < ResourceRef 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', isValid: 'True' obj: 'None'>, 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-832::DEBUG::2012-11-29 15:12:07,747::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-832::DEBUG::2012-11-29 15:12:07,747::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' >Thread-832::DEBUG::2012-11-29 15:12:07,747::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (0 active users) >Thread-832::DEBUG::2012-11-29 15:12:07,747::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free, finding out if anyone is waiting for it. >Thread-832::DEBUG::2012-11-29 15:12:07,748::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', Clearing records. >Thread-832::DEBUG::2012-11-29 15:12:07,748::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-832::DEBUG::2012-11-29 15:12:07,748::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-832::DEBUG::2012-11-29 15:12:07,748::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-832::DEBUG::2012-11-29 15:12:07,748::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-832::DEBUG::2012-11-29 15:12:07,749::task::957::TaskManager.Task::(_decref) Task=`2e631e59-b10d-4268-b664-d57fdef7ede5`::ref 0 aborting False >Thread-838::DEBUG::2012-11-29 15:12:07,778::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-838::DEBUG::2012-11-29 15:12:07,779::task::568::TaskManager.Task::(_updateState) Task=`3f8ae4c1-dafa-4719-a7b8-0dd5a54f031f`::moving from state init -> state preparing >Thread-838::INFO::2012-11-29 15:12:07,779::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-838::INFO::2012-11-29 15:12:07,779::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-838::DEBUG::2012-11-29 15:12:07,779::task::1151::TaskManager.Task::(prepare) Task=`3f8ae4c1-dafa-4719-a7b8-0dd5a54f031f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-838::DEBUG::2012-11-29 15:12:07,780::task::568::TaskManager.Task::(_updateState) Task=`3f8ae4c1-dafa-4719-a7b8-0dd5a54f031f`::moving from state preparing -> state finished >Thread-838::DEBUG::2012-11-29 15:12:07,780::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-838::DEBUG::2012-11-29 15:12:07,780::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-838::DEBUG::2012-11-29 15:12:07,781::task::957::TaskManager.Task::(_decref) Task=`3f8ae4c1-dafa-4719-a7b8-0dd5a54f031f`::ref 0 aborting False >Thread-839::DEBUG::2012-11-29 15:12:07,802::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-839::DEBUG::2012-11-29 15:12:07,802::task::568::TaskManager.Task::(_updateState) Task=`abde4e42-7113-45cf-b479-6635edf4ac2a`::moving from state init -> state preparing >Thread-839::INFO::2012-11-29 15:12:07,803::logUtils::37::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-839::DEBUG::2012-11-29 15:12:07,803::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`dbfa52db-fb6c-47e0-a0ef-66c32372ebdc`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-839::DEBUG::2012-11-29 15:12:07,803::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-839::DEBUG::2012-11-29 15:12:07,803::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'shared' (1 active user) >Thread-839::DEBUG::2012-11-29 15:12:07,804::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`dbfa52db-fb6c-47e0-a0ef-66c32372ebdc`::Granted request >Thread-839::DEBUG::2012-11-29 15:12:07,804::task::794::TaskManager.Task::(resourceAcquired) Task=`abde4e42-7113-45cf-b479-6635edf4ac2a`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-839::DEBUG::2012-11-29 15:12:07,804::task::957::TaskManager.Task::(_decref) Task=`abde4e42-7113-45cf-b479-6635edf4ac2a`::ref 1 aborting False >Thread-839::INFO::2012-11-29 15:12:07,804::fileSD::302::Storage.StorageDomain::(validate) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-840::DEBUG::2012-11-29 15:12:07,807::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-840::DEBUG::2012-11-29 15:12:07,807::task::568::TaskManager.Task::(_updateState) Task=`fb32812f-d599-411c-b2cd-ea979ce269fd`::moving from state init -> state preparing >Thread-840::INFO::2012-11-29 15:12:07,808::logUtils::37::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-839::DEBUG::2012-11-29 15:12:07,811::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5d93bd966b3139ba2a97b71863479fd1506d2da7'] >Thread-840::DEBUG::2012-11-29 15:12:07,812::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`9addb071-3a29-4201-8d21-913a5f741f33`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-840::DEBUG::2012-11-29 15:12:07,814::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'shared' >Thread-839::DEBUG::2012-11-29 15:12:07,815::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-840::DEBUG::2012-11-29 15:12:07,816::resourceManager::504::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-839::DEBUG::2012-11-29 15:12:07,817::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-840::DEBUG::2012-11-29 15:12:07,818::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`9addb071-3a29-4201-8d21-913a5f741f33`::Granted request >Thread-839::DEBUG::2012-11-29 15:12:07,819::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-839::DEBUG::2012-11-29 15:12:07,821::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-840::DEBUG::2012-11-29 15:12:07,822::task::794::TaskManager.Task::(resourceAcquired) Task=`fb32812f-d599-411c-b2cd-ea979ce269fd`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (shared) >Thread-839::DEBUG::2012-11-29 15:12:07,823::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-840::DEBUG::2012-11-29 15:12:07,823::task::957::TaskManager.Task::(_decref) Task=`fb32812f-d599-411c-b2cd-ea979ce269fd`::ref 1 aborting False >Thread-839::DEBUG::2012-11-29 15:12:07,825::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-840::DEBUG::2012-11-29 15:12:07,826::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-840::DEBUG::2012-11-29 15:12:07,826::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-840::DEBUG::2012-11-29 15:12:07,977::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-840::WARNING::2012-11-29 15:12:07,978::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-840::DEBUG::2012-11-29 15:12:07,978::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-840::DEBUG::2012-11-29 15:12:07,985::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-840::DEBUG::2012-11-29 15:12:07,985::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-840::DEBUG::2012-11-29 15:12:07,987::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=5d93bd966b3139ba2a97b71863479fd1506d2da7'] >Thread-840::DEBUG::2012-11-29 15:12:07,989::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-840::WARNING::2012-11-29 15:12:07,989::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-840::WARNING::2012-11-29 15:12:07,989::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-839::DEBUG::2012-11-29 15:12:07,991::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-839::DEBUG::2012-11-29 15:12:07,992::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-839::DEBUG::2012-11-29 15:12:07,993::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-839::DEBUG::2012-11-29 15:12:07,995::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-839::WARNING::2012-11-29 15:12:07,996::fileUtils::184::fileUtils::(createdir) Dir /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93 already exists >Thread-839::DEBUG::2012-11-29 15:12:07,999::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-839::DEBUG::2012-11-29 15:12:08,004::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-840::INFO::2012-11-29 15:12:08,011::logUtils::39::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '860959539200', 'alerts': [], 'disktotal': '860961636352'}}} >Thread-840::DEBUG::2012-11-29 15:12:08,012::task::1151::TaskManager.Task::(prepare) Task=`fb32812f-d599-411c-b2cd-ea979ce269fd`::finished: {'info': {'spm_id': 1, 'master_uuid': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'name': 'DefaultRest', 'version': '3', 'domains': '646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 0}, 'dominfo': {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'status': 'Active', 'diskfree': '860959539200', 'alerts': [], 'disktotal': '860961636352'}}} >Thread-840::DEBUG::2012-11-29 15:12:08,012::task::568::TaskManager.Task::(_updateState) Task=`fb32812f-d599-411c-b2cd-ea979ce269fd`::moving from state preparing -> state finished >Thread-840::DEBUG::2012-11-29 15:12:08,012::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-840::DEBUG::2012-11-29 15:12:08,013::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-840::DEBUG::2012-11-29 15:12:08,013::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-840::DEBUG::2012-11-29 15:12:08,013::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (1 active users) >Thread-840::DEBUG::2012-11-29 15:12:08,014::task::957::TaskManager.Task::(_decref) Task=`fb32812f-d599-411c-b2cd-ea979ce269fd`::ref 0 aborting False >Thread-839::DEBUG::2012-11-29 15:12:08,149::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-839::DEBUG::2012-11-29 15:12:08,149::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-839::INFO::2012-11-29 15:12:08,154::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-839::INFO::2012-11-29 15:12:08,154::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-839::INFO::2012-11-29 15:12:08,155::logUtils::39::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-839::DEBUG::2012-11-29 15:12:08,155::task::1151::TaskManager.Task::(prepare) Task=`abde4e42-7113-45cf-b479-6635edf4ac2a`::finished: None >Thread-839::DEBUG::2012-11-29 15:12:08,155::task::568::TaskManager.Task::(_updateState) Task=`abde4e42-7113-45cf-b479-6635edf4ac2a`::moving from state preparing -> state finished >Thread-839::DEBUG::2012-11-29 15:12:08,155::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-839::DEBUG::2012-11-29 15:12:08,155::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-839::DEBUG::2012-11-29 15:12:08,156::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-839::DEBUG::2012-11-29 15:12:08,156::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-839::DEBUG::2012-11-29 15:12:08,156::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-839::DEBUG::2012-11-29 15:12:08,156::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-839::DEBUG::2012-11-29 15:12:08,157::task::957::TaskManager.Task::(_decref) Task=`abde4e42-7113-45cf-b479-6635edf4ac2a`::ref 0 aborting False >Thread-845::DEBUG::2012-11-29 15:12:08,187::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-845::DEBUG::2012-11-29 15:12:08,188::task::568::TaskManager.Task::(_updateState) Task=`18ea89c4-d105-422d-82b6-fbf3cffd7693`::moving from state init -> state preparing >Thread-845::INFO::2012-11-29 15:12:08,188::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-845::DEBUG::2012-11-29 15:12:08,188::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865' (cwd None) >Thread-845::DEBUG::2012-11-29 15:12:08,220::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-845::DEBUG::2012-11-29 15:12:08,220::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-845::DEBUG::2012-11-29 15:12:08,221::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-845::DEBUG::2012-11-29 15:12:08,221::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-845::DEBUG::2012-11-29 15:12:08,221::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-845::DEBUG::2012-11-29 15:12:08,237::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-845::DEBUG::2012-11-29 15:12:08,238::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-845::DEBUG::2012-11-29 15:12:08,239::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2012-11-29 15:12:08,242::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2012-11-29 15:12:08,244::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2012-11-29 15:12:08,246::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2012-11-29 15:12:08,248::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2012-11-29 15:12:08,250::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2012-11-29 15:12:08,252::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-845::DEBUG::2012-11-29 15:12:08,254::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-845::DEBUG::2012-11-29 15:12:10,257::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-845::DEBUG::2012-11-29 15:12:10,307::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-845::DEBUG::2012-11-29 15:12:10,307::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2012-11-29 15:12:10,307::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2012-11-29 15:12:10,308::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2012-11-29 15:12:10,308::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2012-11-29 15:12:10,308::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-845::DEBUG::2012-11-29 15:12:10,309::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-845::DEBUG::2012-11-29 15:12:10,309::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-845::INFO::2012-11-29 15:12:10,309::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-845::DEBUG::2012-11-29 15:12:10,310::task::1151::TaskManager.Task::(prepare) Task=`18ea89c4-d105-422d-82b6-fbf3cffd7693`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-845::DEBUG::2012-11-29 15:12:10,310::task::568::TaskManager.Task::(_updateState) Task=`18ea89c4-d105-422d-82b6-fbf3cffd7693`::moving from state preparing -> state finished >Thread-845::DEBUG::2012-11-29 15:12:10,310::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-845::DEBUG::2012-11-29 15:12:10,310::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-845::DEBUG::2012-11-29 15:12:10,311::task::957::TaskManager.Task::(_decref) Task=`18ea89c4-d105-422d-82b6-fbf3cffd7693`::ref 0 aborting False >Thread-847::DEBUG::2012-11-29 15:12:10,955::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-847::DEBUG::2012-11-29 15:12:10,955::task::568::TaskManager.Task::(_updateState) Task=`dc0484aa-0db9-49b7-892b-17acf2a93e00`::moving from state init -> state preparing >Thread-847::INFO::2012-11-29 15:12:10,956::logUtils::37::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-847::DEBUG::2012-11-29 15:12:10,956::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`1cfd6d42-d655-41b2-9918-6755d478fc25`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-847::DEBUG::2012-11-29 15:12:10,956::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-847::DEBUG::2012-11-29 15:12:10,957::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-847::DEBUG::2012-11-29 15:12:10,957::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`1cfd6d42-d655-41b2-9918-6755d478fc25`::Granted request >Thread-847::DEBUG::2012-11-29 15:12:10,957::task::794::TaskManager.Task::(resourceAcquired) Task=`dc0484aa-0db9-49b7-892b-17acf2a93e00`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-847::DEBUG::2012-11-29 15:12:10,957::task::957::TaskManager.Task::(_decref) Task=`dc0484aa-0db9-49b7-892b-17acf2a93e00`::ref 1 aborting False >Thread-847::DEBUG::2012-11-29 15:12:10,958::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`c024f0ff-5b47-49fa-99f3-6538208220d2`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-847::DEBUG::2012-11-29 15:12:10,958::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'exclusive' >Thread-847::DEBUG::2012-11-29 15:12:10,958::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'exclusive' (1 active user) >Thread-847::DEBUG::2012-11-29 15:12:10,958::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`c024f0ff-5b47-49fa-99f3-6538208220d2`::Granted request >Thread-847::DEBUG::2012-11-29 15:12:10,959::task::794::TaskManager.Task::(resourceAcquired) Task=`dc0484aa-0db9-49b7-892b-17acf2a93e00`::_resourcesAcquired: Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (exclusive) >Thread-847::DEBUG::2012-11-29 15:12:10,959::task::957::TaskManager.Task::(_decref) Task=`dc0484aa-0db9-49b7-892b-17acf2a93e00`::ref 1 aborting False >Thread-847::INFO::2012-11-29 15:12:10,959::sp::1079::Storage.StoragePool::(deactivateSD) sdUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1 spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-847::INFO::2012-11-29 15:12:10,959::sp::1103::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-847::INFO::2012-11-29 15:12:10,960::logUtils::39::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-847::DEBUG::2012-11-29 15:12:10,960::task::1151::TaskManager.Task::(prepare) Task=`dc0484aa-0db9-49b7-892b-17acf2a93e00`::finished: None >Thread-847::DEBUG::2012-11-29 15:12:10,960::task::568::TaskManager.Task::(_updateState) Task=`dc0484aa-0db9-49b7-892b-17acf2a93e00`::moving from state preparing -> state finished >Thread-847::DEBUG::2012-11-29 15:12:10,960::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1': < ResourceRef 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', isValid: 'True' obj: 'None'>} >Thread-847::DEBUG::2012-11-29 15:12:10,960::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-847::DEBUG::2012-11-29 15:12:10,961::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-847::DEBUG::2012-11-29 15:12:10,961::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-847::DEBUG::2012-11-29 15:12:10,961::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-847::DEBUG::2012-11-29 15:12:10,961::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-847::DEBUG::2012-11-29 15:12:10,962::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >Thread-847::DEBUG::2012-11-29 15:12:10,962::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >Thread-847::DEBUG::2012-11-29 15:12:10,962::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >Thread-847::DEBUG::2012-11-29 15:12:10,962::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >Thread-847::DEBUG::2012-11-29 15:12:10,962::task::957::TaskManager.Task::(_decref) Task=`dc0484aa-0db9-49b7-892b-17acf2a93e00`::ref 0 aborting False >Thread-848::DEBUG::2012-11-29 15:12:11,008::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-848::DEBUG::2012-11-29 15:12:11,008::task::568::TaskManager.Task::(_updateState) Task=`f42de711-f3e9-4f44-a61c-15749319f997`::moving from state init -> state preparing >Thread-848::INFO::2012-11-29 15:12:11,008::logUtils::37::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-848::DEBUG::2012-11-29 15:12:11,008::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-848::DEBUG::2012-11-29 15:12:11,008::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-848::INFO::2012-11-29 15:12:11,009::logUtils::39::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-848::DEBUG::2012-11-29 15:12:11,009::task::1151::TaskManager.Task::(prepare) Task=`f42de711-f3e9-4f44-a61c-15749319f997`::finished: {'allTasksStatus': {}} >Thread-848::DEBUG::2012-11-29 15:12:11,009::task::568::TaskManager.Task::(_updateState) Task=`f42de711-f3e9-4f44-a61c-15749319f997`::moving from state preparing -> state finished >Thread-848::DEBUG::2012-11-29 15:12:11,009::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-848::DEBUG::2012-11-29 15:12:11,009::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-848::DEBUG::2012-11-29 15:12:11,010::task::957::TaskManager.Task::(_decref) Task=`f42de711-f3e9-4f44-a61c-15749319f997`::ref 0 aborting False >Thread-849::DEBUG::2012-11-29 15:12:11,034::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-849::DEBUG::2012-11-29 15:12:11,035::task::568::TaskManager.Task::(_updateState) Task=`73aa73c4-72ef-49ca-8e05-675ab0e0982d`::moving from state init -> state preparing >Thread-849::INFO::2012-11-29 15:12:11,035::logUtils::37::dispatcher::(wrapper) Run and protect: spmStop(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-849::DEBUG::2012-11-29 15:12:11,035::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`62301f95-64a9-46f5-b10b-16e90a91201d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-849::DEBUG::2012-11-29 15:12:11,035::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-849::DEBUG::2012-11-29 15:12:11,036::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-849::DEBUG::2012-11-29 15:12:11,036::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`62301f95-64a9-46f5-b10b-16e90a91201d`::Granted request >Thread-849::DEBUG::2012-11-29 15:12:11,036::task::794::TaskManager.Task::(resourceAcquired) Task=`73aa73c4-72ef-49ca-8e05-675ab0e0982d`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-849::DEBUG::2012-11-29 15:12:11,036::task::957::TaskManager.Task::(_decref) Task=`73aa73c4-72ef-49ca-8e05-675ab0e0982d`::ref 1 aborting False >Thread-849::DEBUG::2012-11-29 15:12:11,037::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-849::DEBUG::2012-11-29 15:12:11,037::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`ad2a9318-c08f-4bf9-aa43-1018e2def6c0`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-849::DEBUG::2012-11-29 15:12:11,037::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-849::DEBUG::2012-11-29 15:12:11,037::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-849::DEBUG::2012-11-29 15:12:11,038::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`ad2a9318-c08f-4bf9-aa43-1018e2def6c0`::Granted request >Thread-849::DEBUG::2012-11-29 15:12:11,038::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-849::DEBUG::2012-11-29 15:12:11,038::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-849::DEBUG::2012-11-29 15:12:11,038::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-849::DEBUG::2012-11-29 15:12:11,039::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-849::DEBUG::2012-11-29 15:12:11,039::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-849::DEBUG::2012-11-29 15:12:11,039::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-849::DEBUG::2012-11-29 15:12:11,040::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=bd78e1b49eb9a0799194190a197f83bd5b88a1c7'] >Thread-849::DEBUG::2012-11-29 15:12:11,047::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-849::INFO::2012-11-29 15:12:11,048::safelease::239::SANLock::(release) Releasing cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-849::DEBUG::2012-11-29 15:12:11,052::safelease::250::SANLock::(release) Cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully released >Thread-849::INFO::2012-11-29 15:12:11,052::logUtils::39::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-849::DEBUG::2012-11-29 15:12:11,052::task::1151::TaskManager.Task::(prepare) Task=`73aa73c4-72ef-49ca-8e05-675ab0e0982d`::finished: None >Thread-849::DEBUG::2012-11-29 15:12:11,052::task::568::TaskManager.Task::(_updateState) Task=`73aa73c4-72ef-49ca-8e05-675ab0e0982d`::moving from state preparing -> state finished >Thread-849::DEBUG::2012-11-29 15:12:11,052::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-849::DEBUG::2012-11-29 15:12:11,053::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-849::DEBUG::2012-11-29 15:12:11,053::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-849::DEBUG::2012-11-29 15:12:11,053::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-849::DEBUG::2012-11-29 15:12:11,053::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-849::DEBUG::2012-11-29 15:12:11,053::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-849::DEBUG::2012-11-29 15:12:11,054::task::957::TaskManager.Task::(_decref) Task=`73aa73c4-72ef-49ca-8e05-675ab0e0982d`::ref 0 aborting False >Thread-850::DEBUG::2012-11-29 15:12:11,085::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-850::DEBUG::2012-11-29 15:12:11,086::task::568::TaskManager.Task::(_updateState) Task=`0c7eff44-fdf0-4f47-8321-7b4000db8f7a`::moving from state init -> state preparing >Thread-850::INFO::2012-11-29 15:12:11,086::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', hostID=1, scsiKey='78cd442d-b34f-452c-9bc5-0b69929d8a93', remove=False, options=None) >Thread-850::DEBUG::2012-11-29 15:12:11,086::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`afacb109-00ba-4def-955a-f83fb18f9a7b`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-850::DEBUG::2012-11-29 15:12:11,087::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-850::DEBUG::2012-11-29 15:12:11,087::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-850::DEBUG::2012-11-29 15:12:11,087::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`afacb109-00ba-4def-955a-f83fb18f9a7b`::Granted request >Thread-850::DEBUG::2012-11-29 15:12:11,087::task::794::TaskManager.Task::(resourceAcquired) Task=`0c7eff44-fdf0-4f47-8321-7b4000db8f7a`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-850::DEBUG::2012-11-29 15:12:11,088::task::957::TaskManager.Task::(_decref) Task=`0c7eff44-fdf0-4f47-8321-7b4000db8f7a`::ref 1 aborting False >Thread-850::INFO::2012-11-29 15:12:11,088::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-444::DEBUG::2012-11-29 15:12:11,088::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-444::INFO::2012-11-29 15:12:11,088::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 1) >Thread-444::DEBUG::2012-11-29 15:12:13,089::safelease::193::SANLock::(releaseHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 released successfully (id: 1) >Thread-850::INFO::2012-11-29 15:12:13,089::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-850::DEBUG::2012-11-29 15:12:13,090::task::1151::TaskManager.Task::(prepare) Task=`0c7eff44-fdf0-4f47-8321-7b4000db8f7a`::finished: True >Thread-850::DEBUG::2012-11-29 15:12:13,090::task::568::TaskManager.Task::(_updateState) Task=`0c7eff44-fdf0-4f47-8321-7b4000db8f7a`::moving from state preparing -> state finished >Thread-850::DEBUG::2012-11-29 15:12:13,090::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >Thread-850::DEBUG::2012-11-29 15:12:13,090::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-850::DEBUG::2012-11-29 15:12:13,090::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-850::DEBUG::2012-11-29 15:12:13,090::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-850::DEBUG::2012-11-29 15:12:13,091::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-850::DEBUG::2012-11-29 15:12:13,091::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-850::DEBUG::2012-11-29 15:12:13,091::task::957::TaskManager.Task::(_decref) Task=`0c7eff44-fdf0-4f47-8321-7b4000db8f7a`::ref 0 aborting False >Thread-852::DEBUG::2012-11-29 15:12:13,122::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-852::DEBUG::2012-11-29 15:12:13,122::task::568::TaskManager.Task::(_updateState) Task=`3e0a1b36-1a9c-434e-8f8f-a2b9d54a9f6a`::moving from state init -> state preparing >Thread-852::INFO::2012-11-29 15:12:13,122::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-852::DEBUG::2012-11-29 15:12:13,123::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990' (cwd None) >Thread-852::DEBUG::2012-11-29 15:12:13,144::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-852::DEBUG::2012-11-29 15:12:13,144::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-852::DEBUG::2012-11-29 15:12:13,144::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-852::DEBUG::2012-11-29 15:12:13,144::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-852::DEBUG::2012-11-29 15:12:13,145::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-852::DEBUG::2012-11-29 15:12:13,158::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-852::DEBUG::2012-11-29 15:12:13,158::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-852::DEBUG::2012-11-29 15:12:13,160::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-852::DEBUG::2012-11-29 15:12:13,162::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-852::DEBUG::2012-11-29 15:12:13,164::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-852::DEBUG::2012-11-29 15:12:13,166::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-852::DEBUG::2012-11-29 15:12:13,168::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-852::DEBUG::2012-11-29 15:12:13,171::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-852::DEBUG::2012-11-29 15:12:13,173::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-852::DEBUG::2012-11-29 15:12:13,175::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-852::DEBUG::2012-11-29 15:12:15,178::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-852::DEBUG::2012-11-29 15:12:15,224::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-852::DEBUG::2012-11-29 15:12:15,225::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-852::DEBUG::2012-11-29 15:12:15,225::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-852::DEBUG::2012-11-29 15:12:15,225::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-852::DEBUG::2012-11-29 15:12:15,226::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-852::DEBUG::2012-11-29 15:12:15,226::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-852::DEBUG::2012-11-29 15:12:15,226::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-852::DEBUG::2012-11-29 15:12:15,227::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-852::INFO::2012-11-29 15:12:15,227::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-852::DEBUG::2012-11-29 15:12:15,227::task::1151::TaskManager.Task::(prepare) Task=`3e0a1b36-1a9c-434e-8f8f-a2b9d54a9f6a`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-852::DEBUG::2012-11-29 15:12:15,227::task::568::TaskManager.Task::(_updateState) Task=`3e0a1b36-1a9c-434e-8f8f-a2b9d54a9f6a`::moving from state preparing -> state finished >Thread-852::DEBUG::2012-11-29 15:12:15,228::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-852::DEBUG::2012-11-29 15:12:15,228::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-852::DEBUG::2012-11-29 15:12:15,228::task::957::TaskManager.Task::(_decref) Task=`3e0a1b36-1a9c-434e-8f8f-a2b9d54a9f6a`::ref 0 aborting False >Thread-855::DEBUG::2012-11-29 15:12:16,153::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-855::DEBUG::2012-11-29 15:12:16,153::task::568::TaskManager.Task::(_updateState) Task=`abb2aef5-95b0-4eb6-ba88-5bd334f417c3`::moving from state init -> state preparing >Thread-855::INFO::2012-11-29 15:12:16,153::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-855::INFO::2012-11-29 15:12:16,153::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-855::DEBUG::2012-11-29 15:12:16,153::task::1151::TaskManager.Task::(prepare) Task=`abb2aef5-95b0-4eb6-ba88-5bd334f417c3`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-855::DEBUG::2012-11-29 15:12:16,154::task::568::TaskManager.Task::(_updateState) Task=`abb2aef5-95b0-4eb6-ba88-5bd334f417c3`::moving from state preparing -> state finished >Thread-855::DEBUG::2012-11-29 15:12:16,154::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-855::DEBUG::2012-11-29 15:12:16,154::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-855::DEBUG::2012-11-29 15:12:16,154::task::957::TaskManager.Task::(_decref) Task=`abb2aef5-95b0-4eb6-ba88-5bd334f417c3`::ref 0 aborting False >Thread-856::DEBUG::2012-11-29 15:12:16,181::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-856::DEBUG::2012-11-29 15:12:16,181::task::568::TaskManager.Task::(_updateState) Task=`e3372f4c-a0d3-4315-b914-1422e2fb859f`::moving from state init -> state preparing >Thread-856::INFO::2012-11-29 15:12:16,182::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-856::DEBUG::2012-11-29 15:12:16,184::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990' (cwd None) >Thread-856::INFO::2012-11-29 15:12:16,210::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-856::DEBUG::2012-11-29 15:12:16,210::task::1151::TaskManager.Task::(prepare) Task=`e3372f4c-a0d3-4315-b914-1422e2fb859f`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-856::DEBUG::2012-11-29 15:12:16,210::task::568::TaskManager.Task::(_updateState) Task=`e3372f4c-a0d3-4315-b914-1422e2fb859f`::moving from state preparing -> state finished >Thread-856::DEBUG::2012-11-29 15:12:16,210::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-856::DEBUG::2012-11-29 15:12:16,211::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-856::DEBUG::2012-11-29 15:12:16,211::task::957::TaskManager.Task::(_decref) Task=`e3372f4c-a0d3-4315-b914-1422e2fb859f`::ref 0 aborting False >Thread-857::DEBUG::2012-11-29 15:12:16,241::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-857::DEBUG::2012-11-29 15:12:16,241::task::568::TaskManager.Task::(_updateState) Task=`9ed5b509-6755-4354-96b0-86c0c79d3df3`::moving from state init -> state preparing >Thread-857::INFO::2012-11-29 15:12:16,241::logUtils::37::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', hostID=1, scsiKey='78cd442d-b34f-452c-9bc5-0b69929d8a93', msdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', masterVersion=1, options=None) >Thread-857::DEBUG::2012-11-29 15:12:16,242::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`82ad7486-0161-41d5-81a9-9dc711351533`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-857::DEBUG::2012-11-29 15:12:16,242::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-857::DEBUG::2012-11-29 15:12:16,242::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-857::DEBUG::2012-11-29 15:12:16,242::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`82ad7486-0161-41d5-81a9-9dc711351533`::Granted request >Thread-857::INFO::2012-11-29 15:12:16,243::sp::628::Storage.StoragePool::(connect) Connect host #1 to the storage pool 78cd442d-b34f-452c-9bc5-0b69929d8a93 with master domain: 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (ver = 1) >Thread-857::DEBUG::2012-11-29 15:12:16,243::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:16,244::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:16,244::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:16,244::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:16,244::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:16,245::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:16,245::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-857::DEBUG::2012-11-29 15:12:16,245::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-857::DEBUG::2012-11-29 15:12:16,245::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-857::DEBUG::2012-11-29 15:12:16,245::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-857::DEBUG::2012-11-29 15:12:16,246::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-857::DEBUG::2012-11-29 15:12:16,259::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-857::DEBUG::2012-11-29 15:12:16,259::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-857::DEBUG::2012-11-29 15:12:16,261::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-857::DEBUG::2012-11-29 15:12:16,263::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-857::DEBUG::2012-11-29 15:12:16,265::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-857::DEBUG::2012-11-29 15:12:16,268::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-857::DEBUG::2012-11-29 15:12:16,270::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-857::DEBUG::2012-11-29 15:12:16,272::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-857::DEBUG::2012-11-29 15:12:16,274::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-857::DEBUG::2012-11-29 15:12:16,276::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-858::DEBUG::2012-11-29 15:12:17,928::task::568::TaskManager.Task::(_updateState) Task=`a5958f27-feca-4ce4-996e-6c891d5f8e9b`::moving from state init -> state preparing >Thread-858::INFO::2012-11-29 15:12:17,929::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-858::INFO::2012-11-29 15:12:17,929::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-858::DEBUG::2012-11-29 15:12:17,929::task::1151::TaskManager.Task::(prepare) Task=`a5958f27-feca-4ce4-996e-6c891d5f8e9b`::finished: {} >Thread-858::DEBUG::2012-11-29 15:12:17,929::task::568::TaskManager.Task::(_updateState) Task=`a5958f27-feca-4ce4-996e-6c891d5f8e9b`::moving from state preparing -> state finished >Thread-858::DEBUG::2012-11-29 15:12:17,929::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-858::DEBUG::2012-11-29 15:12:17,929::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-858::DEBUG::2012-11-29 15:12:17,930::task::957::TaskManager.Task::(_decref) Task=`a5958f27-feca-4ce4-996e-6c891d5f8e9b`::ref 0 aborting False >Thread-857::DEBUG::2012-11-29 15:12:18,279::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-857::DEBUG::2012-11-29 15:12:18,331::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-857::DEBUG::2012-11-29 15:12:18,331::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,332::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,332::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,332::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,333::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,333::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,333::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-857::DEBUG::2012-11-29 15:12:18,333::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,335::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-857::DEBUG::2012-11-29 15:12:18,488::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-857::WARNING::2012-11-29 15:12:18,489::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-857::DEBUG::2012-11-29 15:12:18,489::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,494::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-857::DEBUG::2012-11-29 15:12:18,494::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-857::DEBUG::2012-11-29 15:12:18,498::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=bd78e1b49eb9a0799194190a197f83bd5b88a1c7'] >Thread-857::DEBUG::2012-11-29 15:12:18,500::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-857::WARNING::2012-11-29 15:12:18,500::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-857::WARNING::2012-11-29 15:12:18,500::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-857::DEBUG::2012-11-29 15:12:18,500::sp::1535::Storage.StoragePool::(getMasterDomain) Master domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 verified, version 1 >Thread-857::DEBUG::2012-11-29 15:12:18,501::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-857::DEBUG::2012-11-29 15:12:18,501::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-857::DEBUG::2012-11-29 15:12:18,503::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=bd78e1b49eb9a0799194190a197f83bd5b88a1c7'] >Thread-857::DEBUG::2012-11-29 15:12:18,504::sp::1569::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` started monitoring domain `646a3b8e-d5dd-4bf7-be3d-384526eabdd1` >Thread-861::DEBUG::2012-11-29 15:12:18,504::domainMonitor::143::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-857::DEBUG::2012-11-29 15:12:18,505::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-857::DEBUG::2012-11-29 15:12:18,507::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-857::DEBUG::2012-11-29 15:12:18,511::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free' (cwd None) >Thread-861::INFO::2012-11-29 15:12:18,526::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 1) >Thread-861::DEBUG::2012-11-29 15:12:18,526::safelease::178::SANLock::(acquireHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully acquired (id: 1) >Thread-857::DEBUG::2012-11-29 15:12:18,656::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-857::DEBUG::2012-11-29 15:12:18,656::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-857::INFO::2012-11-29 15:12:18,658::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-857::INFO::2012-11-29 15:12:18,658::sp::1129::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 to /rhev/data-center/78cd442d-b34f-452c-9bc5-0b69929d8a93/mastersd >Thread-857::DEBUG::2012-11-29 15:12:18,659::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-857::DEBUG::2012-11-29 15:12:18,659::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-857::DEBUG::2012-11-29 15:12:18,659::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-857::DEBUG::2012-11-29 15:12:18,659::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-857::INFO::2012-11-29 15:12:18,660::logUtils::39::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-857::DEBUG::2012-11-29 15:12:18,660::task::1151::TaskManager.Task::(prepare) Task=`9ed5b509-6755-4354-96b0-86c0c79d3df3`::finished: True >Thread-857::DEBUG::2012-11-29 15:12:18,660::task::568::TaskManager.Task::(_updateState) Task=`9ed5b509-6755-4354-96b0-86c0c79d3df3`::moving from state preparing -> state finished >Thread-857::DEBUG::2012-11-29 15:12:18,660::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-857::DEBUG::2012-11-29 15:12:18,661::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-857::DEBUG::2012-11-29 15:12:18,661::task::957::TaskManager.Task::(_decref) Task=`9ed5b509-6755-4354-96b0-86c0c79d3df3`::ref 0 aborting False >Thread-863::DEBUG::2012-11-29 15:12:18,734::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-863::DEBUG::2012-11-29 15:12:18,735::task::568::TaskManager.Task::(_updateState) Task=`ba630501-0b9d-407b-b580-b489c1540838`::moving from state init -> state preparing >Thread-863::INFO::2012-11-29 15:12:18,735::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-863::INFO::2012-11-29 15:12:18,735::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-863::DEBUG::2012-11-29 15:12:18,735::task::1151::TaskManager.Task::(prepare) Task=`ba630501-0b9d-407b-b580-b489c1540838`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-863::DEBUG::2012-11-29 15:12:18,735::task::568::TaskManager.Task::(_updateState) Task=`ba630501-0b9d-407b-b580-b489c1540838`::moving from state preparing -> state finished >Thread-863::DEBUG::2012-11-29 15:12:18,736::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-863::DEBUG::2012-11-29 15:12:18,736::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-863::DEBUG::2012-11-29 15:12:18,736::task::957::TaskManager.Task::(_decref) Task=`ba630501-0b9d-407b-b580-b489c1540838`::ref 0 aborting False >Thread-864::DEBUG::2012-11-29 15:12:18,767::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-864::DEBUG::2012-11-29 15:12:18,767::task::568::TaskManager.Task::(_updateState) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::moving from state init -> state preparing >Thread-864::INFO::2012-11-29 15:12:18,768::logUtils::37::dispatcher::(wrapper) Run and protect: spmStart(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', prevID=-1, prevLVER='0', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None) >Thread-864::DEBUG::2012-11-29 15:12:18,768::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`021b477f-1cff-41d6-b1b0-d73032157d95`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-864::DEBUG::2012-11-29 15:12:18,768::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-864::DEBUG::2012-11-29 15:12:18,769::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-864::DEBUG::2012-11-29 15:12:18,769::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`021b477f-1cff-41d6-b1b0-d73032157d95`::Granted request >Thread-864::DEBUG::2012-11-29 15:12:18,769::task::794::TaskManager.Task::(resourceAcquired) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-864::DEBUG::2012-11-29 15:12:18,769::task::957::TaskManager.Task::(_decref) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::ref 1 aborting False >Thread-864::INFO::2012-11-29 15:12:18,770::logUtils::39::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-864::DEBUG::2012-11-29 15:12:18,770::task::1146::TaskManager.Task::(prepare) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::Prepare: 1 jobs exist, move to acquiring >Thread-864::DEBUG::2012-11-29 15:12:18,770::task::568::TaskManager.Task::(_updateState) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::moving from state preparing -> state acquiring >Thread-864::DEBUG::2012-11-29 15:12:18,770::task::568::TaskManager.Task::(_updateState) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::moving from state acquiring -> state queued >Thread-864::DEBUG::2012-11-29 15:12:18,770::taskManager::50::TaskManager::(_queueTask) queuing task: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-864::DEBUG::2012-11-29 15:12:18,771::taskManager::56::TaskManager::(_queueTask) task queued: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >c6e85019-8176-4c95-89fc-34ca1d277c2b::DEBUG::2012-11-29 15:12:18,771::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-864::DEBUG::2012-11-29 15:12:18,772::task::1148::TaskManager.Task::(prepare) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::returning >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,772::threadPool::200::Misc.ThreadPool.WorkerThread::(run) Task: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d running: <bound method Task.commit of <storage.task.Task instance at 0x7fc0fc3bb6c8>> with: None >Thread-864::DEBUG::2012-11-29 15:12:18,774::task::957::TaskManager.Task::(_decref) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::ref 0 aborting False >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,774::task::1159::TaskManager.Task::(commit) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::committing task: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,776::task::568::TaskManager.Task::(_updateState) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::moving from state queued -> state running >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,777::task::872::TaskManager.Task::(_runJobs) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fc0fc629f90>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,779::task::304::TaskManager.Task::(run) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7fc0fc629f90>> (args: (-1, '0', 'false', 250, 3) kwargs: {}) callback None >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,779::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,779::misc::1027::SamplingMethod::(__call__) Got in to sampling method >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,782::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=bd78e1b49eb9a0799194190a197f83bd5b88a1c7'] >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,783::misc::1035::SamplingMethod::(__call__) Returning last result >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:18,786::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=bd78e1b49eb9a0799194190a197f83bd5b88a1c7'] >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::INFO::2012-11-29 15:12:18,786::safelease::160::SANLock::(acquireHostId) Acquiring host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 1) >Thread-865::DEBUG::2012-11-29 15:12:19,806::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-865::DEBUG::2012-11-29 15:12:19,806::task::568::TaskManager.Task::(_updateState) Task=`3df5c84d-d906-4447-a577-145689174a43`::moving from state init -> state preparing >Thread-865::INFO::2012-11-29 15:12:19,806::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-865::DEBUG::2012-11-29 15:12:19,806::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-865::DEBUG::2012-11-29 15:12:19,807::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-865::INFO::2012-11-29 15:12:19,807::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-865::DEBUG::2012-11-29 15:12:19,807::task::1151::TaskManager.Task::(prepare) Task=`3df5c84d-d906-4447-a577-145689174a43`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-865::DEBUG::2012-11-29 15:12:19,807::task::568::TaskManager.Task::(_updateState) Task=`3df5c84d-d906-4447-a577-145689174a43`::moving from state preparing -> state finished >Thread-865::DEBUG::2012-11-29 15:12:19,807::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-865::DEBUG::2012-11-29 15:12:19,808::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-865::DEBUG::2012-11-29 15:12:19,808::task::957::TaskManager.Task::(_decref) Task=`3df5c84d-d906-4447-a577-145689174a43`::ref 0 aborting False >Thread-867::DEBUG::2012-11-29 15:12:20,836::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-867::DEBUG::2012-11-29 15:12:20,836::task::568::TaskManager.Task::(_updateState) Task=`ac1cf681-9a8f-4fb6-9aa0-ae8822481f04`::moving from state init -> state preparing >Thread-867::INFO::2012-11-29 15:12:20,836::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-867::DEBUG::2012-11-29 15:12:20,836::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-867::DEBUG::2012-11-29 15:12:20,837::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-867::INFO::2012-11-29 15:12:20,837::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-867::DEBUG::2012-11-29 15:12:20,837::task::1151::TaskManager.Task::(prepare) Task=`ac1cf681-9a8f-4fb6-9aa0-ae8822481f04`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-867::DEBUG::2012-11-29 15:12:20,837::task::568::TaskManager.Task::(_updateState) Task=`ac1cf681-9a8f-4fb6-9aa0-ae8822481f04`::moving from state preparing -> state finished >Thread-867::DEBUG::2012-11-29 15:12:20,837::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-867::DEBUG::2012-11-29 15:12:20,838::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-867::DEBUG::2012-11-29 15:12:20,838::task::957::TaskManager.Task::(_decref) Task=`ac1cf681-9a8f-4fb6-9aa0-ae8822481f04`::ref 0 aborting False >Thread-868::DEBUG::2012-11-29 15:12:21,865::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-868::DEBUG::2012-11-29 15:12:21,865::task::568::TaskManager.Task::(_updateState) Task=`6b2dc1bb-8a52-4a2b-94c2-e99cdf3dbd50`::moving from state init -> state preparing >Thread-868::INFO::2012-11-29 15:12:21,865::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-868::DEBUG::2012-11-29 15:12:21,865::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-868::DEBUG::2012-11-29 15:12:21,866::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-868::INFO::2012-11-29 15:12:21,866::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-868::DEBUG::2012-11-29 15:12:21,866::task::1151::TaskManager.Task::(prepare) Task=`6b2dc1bb-8a52-4a2b-94c2-e99cdf3dbd50`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-868::DEBUG::2012-11-29 15:12:21,866::task::568::TaskManager.Task::(_updateState) Task=`6b2dc1bb-8a52-4a2b-94c2-e99cdf3dbd50`::moving from state preparing -> state finished >Thread-868::DEBUG::2012-11-29 15:12:21,866::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-868::DEBUG::2012-11-29 15:12:21,866::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-868::DEBUG::2012-11-29 15:12:21,867::task::957::TaskManager.Task::(_decref) Task=`6b2dc1bb-8a52-4a2b-94c2-e99cdf3dbd50`::ref 0 aborting False >Thread-870::DEBUG::2012-11-29 15:12:22,897::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-870::DEBUG::2012-11-29 15:12:22,897::task::568::TaskManager.Task::(_updateState) Task=`45b40c06-ffb2-41a4-935a-2dc8eb62c0eb`::moving from state init -> state preparing >Thread-870::INFO::2012-11-29 15:12:22,897::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-870::DEBUG::2012-11-29 15:12:22,897::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-870::DEBUG::2012-11-29 15:12:22,897::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-870::INFO::2012-11-29 15:12:22,898::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-870::DEBUG::2012-11-29 15:12:22,898::task::1151::TaskManager.Task::(prepare) Task=`45b40c06-ffb2-41a4-935a-2dc8eb62c0eb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-870::DEBUG::2012-11-29 15:12:22,898::task::568::TaskManager.Task::(_updateState) Task=`45b40c06-ffb2-41a4-935a-2dc8eb62c0eb`::moving from state preparing -> state finished >Thread-870::DEBUG::2012-11-29 15:12:22,898::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-870::DEBUG::2012-11-29 15:12:22,898::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-870::DEBUG::2012-11-29 15:12:22,898::task::957::TaskManager.Task::(_decref) Task=`45b40c06-ffb2-41a4-935a-2dc8eb62c0eb`::ref 0 aborting False >Thread-871::DEBUG::2012-11-29 15:12:23,925::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-871::DEBUG::2012-11-29 15:12:23,926::task::568::TaskManager.Task::(_updateState) Task=`442e5b4f-8fff-4887-b40c-44e41213bf0b`::moving from state init -> state preparing >Thread-871::INFO::2012-11-29 15:12:23,926::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-871::DEBUG::2012-11-29 15:12:23,926::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-871::DEBUG::2012-11-29 15:12:23,926::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-871::INFO::2012-11-29 15:12:23,926::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-871::DEBUG::2012-11-29 15:12:23,926::task::1151::TaskManager.Task::(prepare) Task=`442e5b4f-8fff-4887-b40c-44e41213bf0b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-871::DEBUG::2012-11-29 15:12:23,927::task::568::TaskManager.Task::(_updateState) Task=`442e5b4f-8fff-4887-b40c-44e41213bf0b`::moving from state preparing -> state finished >Thread-871::DEBUG::2012-11-29 15:12:23,927::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-871::DEBUG::2012-11-29 15:12:23,927::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-871::DEBUG::2012-11-29 15:12:23,927::task::957::TaskManager.Task::(_decref) Task=`442e5b4f-8fff-4887-b40c-44e41213bf0b`::ref 0 aborting False >Thread-873::DEBUG::2012-11-29 15:12:24,954::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-873::DEBUG::2012-11-29 15:12:24,954::task::568::TaskManager.Task::(_updateState) Task=`8f6272fc-b90e-4383-99c0-d8f75f28a46f`::moving from state init -> state preparing >Thread-873::INFO::2012-11-29 15:12:24,954::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-873::DEBUG::2012-11-29 15:12:24,955::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-873::DEBUG::2012-11-29 15:12:24,955::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-873::INFO::2012-11-29 15:12:24,955::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-873::DEBUG::2012-11-29 15:12:24,955::task::1151::TaskManager.Task::(prepare) Task=`8f6272fc-b90e-4383-99c0-d8f75f28a46f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-873::DEBUG::2012-11-29 15:12:24,955::task::568::TaskManager.Task::(_updateState) Task=`8f6272fc-b90e-4383-99c0-d8f75f28a46f`::moving from state preparing -> state finished >Thread-873::DEBUG::2012-11-29 15:12:24,955::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-873::DEBUG::2012-11-29 15:12:24,956::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-873::DEBUG::2012-11-29 15:12:24,956::task::957::TaskManager.Task::(_decref) Task=`8f6272fc-b90e-4383-99c0-d8f75f28a46f`::ref 0 aborting False >Thread-874::DEBUG::2012-11-29 15:12:25,983::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-874::DEBUG::2012-11-29 15:12:25,984::task::568::TaskManager.Task::(_updateState) Task=`9bb6a28b-8f08-4782-80a6-e84710bf33b0`::moving from state init -> state preparing >Thread-874::INFO::2012-11-29 15:12:25,984::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-874::DEBUG::2012-11-29 15:12:25,984::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-874::DEBUG::2012-11-29 15:12:25,984::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-874::INFO::2012-11-29 15:12:25,984::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-874::DEBUG::2012-11-29 15:12:25,984::task::1151::TaskManager.Task::(prepare) Task=`9bb6a28b-8f08-4782-80a6-e84710bf33b0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-874::DEBUG::2012-11-29 15:12:25,985::task::568::TaskManager.Task::(_updateState) Task=`9bb6a28b-8f08-4782-80a6-e84710bf33b0`::moving from state preparing -> state finished >Thread-874::DEBUG::2012-11-29 15:12:25,985::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-874::DEBUG::2012-11-29 15:12:25,985::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-874::DEBUG::2012-11-29 15:12:25,985::task::957::TaskManager.Task::(_decref) Task=`9bb6a28b-8f08-4782-80a6-e84710bf33b0`::ref 0 aborting False >Thread-876::DEBUG::2012-11-29 15:12:27,012::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-876::DEBUG::2012-11-29 15:12:27,013::task::568::TaskManager.Task::(_updateState) Task=`e4902f4f-6e92-473a-b323-465b9b942a8f`::moving from state init -> state preparing >Thread-876::INFO::2012-11-29 15:12:27,013::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-876::DEBUG::2012-11-29 15:12:27,013::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-876::DEBUG::2012-11-29 15:12:27,013::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-876::INFO::2012-11-29 15:12:27,013::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-876::DEBUG::2012-11-29 15:12:27,014::task::1151::TaskManager.Task::(prepare) Task=`e4902f4f-6e92-473a-b323-465b9b942a8f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-876::DEBUG::2012-11-29 15:12:27,014::task::568::TaskManager.Task::(_updateState) Task=`e4902f4f-6e92-473a-b323-465b9b942a8f`::moving from state preparing -> state finished >Thread-876::DEBUG::2012-11-29 15:12:27,014::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-876::DEBUG::2012-11-29 15:12:27,014::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-876::DEBUG::2012-11-29 15:12:27,014::task::957::TaskManager.Task::(_decref) Task=`e4902f4f-6e92-473a-b323-465b9b942a8f`::ref 0 aborting False >Thread-877::DEBUG::2012-11-29 15:12:28,041::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-877::DEBUG::2012-11-29 15:12:28,041::task::568::TaskManager.Task::(_updateState) Task=`e26720e6-2d39-4c97-9e20-75535c751929`::moving from state init -> state preparing >Thread-877::INFO::2012-11-29 15:12:28,041::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-877::DEBUG::2012-11-29 15:12:28,041::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-877::DEBUG::2012-11-29 15:12:28,042::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-877::INFO::2012-11-29 15:12:28,042::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-877::DEBUG::2012-11-29 15:12:28,042::task::1151::TaskManager.Task::(prepare) Task=`e26720e6-2d39-4c97-9e20-75535c751929`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-877::DEBUG::2012-11-29 15:12:28,042::task::568::TaskManager.Task::(_updateState) Task=`e26720e6-2d39-4c97-9e20-75535c751929`::moving from state preparing -> state finished >Thread-877::DEBUG::2012-11-29 15:12:28,042::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-877::DEBUG::2012-11-29 15:12:28,042::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-877::DEBUG::2012-11-29 15:12:28,043::task::957::TaskManager.Task::(_decref) Task=`e26720e6-2d39-4c97-9e20-75535c751929`::ref 0 aborting False >Thread-878::DEBUG::2012-11-29 15:12:28,117::task::568::TaskManager.Task::(_updateState) Task=`e9f56c38-e743-42f0-b651-237365c24b6b`::moving from state init -> state preparing >Thread-878::INFO::2012-11-29 15:12:28,117::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-878::INFO::2012-11-29 15:12:28,117::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00224900245667', 'lastCheck': '9.6', 'code': 0, 'valid': True}} >Thread-878::DEBUG::2012-11-29 15:12:28,117::task::1151::TaskManager.Task::(prepare) Task=`e9f56c38-e743-42f0-b651-237365c24b6b`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00224900245667', 'lastCheck': '9.6', 'code': 0, 'valid': True}} >Thread-878::DEBUG::2012-11-29 15:12:28,117::task::568::TaskManager.Task::(_updateState) Task=`e9f56c38-e743-42f0-b651-237365c24b6b`::moving from state preparing -> state finished >Thread-878::DEBUG::2012-11-29 15:12:28,118::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-878::DEBUG::2012-11-29 15:12:28,118::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-878::DEBUG::2012-11-29 15:12:28,118::task::957::TaskManager.Task::(_decref) Task=`e9f56c38-e743-42f0-b651-237365c24b6b`::ref 0 aborting False >Thread-880::DEBUG::2012-11-29 15:12:29,070::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-880::DEBUG::2012-11-29 15:12:29,070::task::568::TaskManager.Task::(_updateState) Task=`e23168f6-2ef2-492d-89df-7a0ed016aeba`::moving from state init -> state preparing >Thread-880::INFO::2012-11-29 15:12:29,071::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-880::DEBUG::2012-11-29 15:12:29,071::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-880::DEBUG::2012-11-29 15:12:29,071::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-880::INFO::2012-11-29 15:12:29,071::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-880::DEBUG::2012-11-29 15:12:29,071::task::1151::TaskManager.Task::(prepare) Task=`e23168f6-2ef2-492d-89df-7a0ed016aeba`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-880::DEBUG::2012-11-29 15:12:29,071::task::568::TaskManager.Task::(_updateState) Task=`e23168f6-2ef2-492d-89df-7a0ed016aeba`::moving from state preparing -> state finished >Thread-880::DEBUG::2012-11-29 15:12:29,072::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-880::DEBUG::2012-11-29 15:12:29,072::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-880::DEBUG::2012-11-29 15:12:29,072::task::957::TaskManager.Task::(_decref) Task=`e23168f6-2ef2-492d-89df-7a0ed016aeba`::ref 0 aborting False >Thread-881::DEBUG::2012-11-29 15:12:30,099::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-881::DEBUG::2012-11-29 15:12:30,099::task::568::TaskManager.Task::(_updateState) Task=`290c4eb4-56f6-4e23-82ed-e80a9a021993`::moving from state init -> state preparing >Thread-881::INFO::2012-11-29 15:12:30,099::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-881::DEBUG::2012-11-29 15:12:30,100::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-881::DEBUG::2012-11-29 15:12:30,100::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-881::INFO::2012-11-29 15:12:30,100::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-881::DEBUG::2012-11-29 15:12:30,100::task::1151::TaskManager.Task::(prepare) Task=`290c4eb4-56f6-4e23-82ed-e80a9a021993`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-881::DEBUG::2012-11-29 15:12:30,100::task::568::TaskManager.Task::(_updateState) Task=`290c4eb4-56f6-4e23-82ed-e80a9a021993`::moving from state preparing -> state finished >Thread-881::DEBUG::2012-11-29 15:12:30,100::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-881::DEBUG::2012-11-29 15:12:30,100::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-881::DEBUG::2012-11-29 15:12:30,101::task::957::TaskManager.Task::(_decref) Task=`290c4eb4-56f6-4e23-82ed-e80a9a021993`::ref 0 aborting False >Thread-883::DEBUG::2012-11-29 15:12:31,127::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-883::DEBUG::2012-11-29 15:12:31,128::task::568::TaskManager.Task::(_updateState) Task=`cb40da41-264c-427e-aa96-715874efa266`::moving from state init -> state preparing >Thread-883::INFO::2012-11-29 15:12:31,128::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-883::DEBUG::2012-11-29 15:12:31,128::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-883::DEBUG::2012-11-29 15:12:31,128::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-883::INFO::2012-11-29 15:12:31,128::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-883::DEBUG::2012-11-29 15:12:31,129::task::1151::TaskManager.Task::(prepare) Task=`cb40da41-264c-427e-aa96-715874efa266`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-883::DEBUG::2012-11-29 15:12:31,129::task::568::TaskManager.Task::(_updateState) Task=`cb40da41-264c-427e-aa96-715874efa266`::moving from state preparing -> state finished >Thread-883::DEBUG::2012-11-29 15:12:31,129::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-883::DEBUG::2012-11-29 15:12:31,129::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-883::DEBUG::2012-11-29 15:12:31,129::task::957::TaskManager.Task::(_decref) Task=`cb40da41-264c-427e-aa96-715874efa266`::ref 0 aborting False >Thread-884::DEBUG::2012-11-29 15:12:32,157::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-884::DEBUG::2012-11-29 15:12:32,157::task::568::TaskManager.Task::(_updateState) Task=`d1ce7b68-f4a1-4d26-a00f-9eef2ec4c888`::moving from state init -> state preparing >Thread-884::INFO::2012-11-29 15:12:32,157::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-884::DEBUG::2012-11-29 15:12:32,157::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-884::DEBUG::2012-11-29 15:12:32,158::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-884::INFO::2012-11-29 15:12:32,158::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-884::DEBUG::2012-11-29 15:12:32,158::task::1151::TaskManager.Task::(prepare) Task=`d1ce7b68-f4a1-4d26-a00f-9eef2ec4c888`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-884::DEBUG::2012-11-29 15:12:32,158::task::568::TaskManager.Task::(_updateState) Task=`d1ce7b68-f4a1-4d26-a00f-9eef2ec4c888`::moving from state preparing -> state finished >Thread-884::DEBUG::2012-11-29 15:12:32,158::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-884::DEBUG::2012-11-29 15:12:32,158::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-884::DEBUG::2012-11-29 15:12:32,159::task::957::TaskManager.Task::(_decref) Task=`d1ce7b68-f4a1-4d26-a00f-9eef2ec4c888`::ref 0 aborting False >Thread-886::DEBUG::2012-11-29 15:12:33,186::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-886::DEBUG::2012-11-29 15:12:33,187::task::568::TaskManager.Task::(_updateState) Task=`cd3aa1ca-385f-4525-88d9-6a045ab9bcb6`::moving from state init -> state preparing >Thread-886::INFO::2012-11-29 15:12:33,187::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-886::DEBUG::2012-11-29 15:12:33,187::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-886::DEBUG::2012-11-29 15:12:33,187::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-886::INFO::2012-11-29 15:12:33,187::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-886::DEBUG::2012-11-29 15:12:33,187::task::1151::TaskManager.Task::(prepare) Task=`cd3aa1ca-385f-4525-88d9-6a045ab9bcb6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-886::DEBUG::2012-11-29 15:12:33,188::task::568::TaskManager.Task::(_updateState) Task=`cd3aa1ca-385f-4525-88d9-6a045ab9bcb6`::moving from state preparing -> state finished >Thread-886::DEBUG::2012-11-29 15:12:33,188::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-886::DEBUG::2012-11-29 15:12:33,188::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-886::DEBUG::2012-11-29 15:12:33,188::task::957::TaskManager.Task::(_decref) Task=`cd3aa1ca-385f-4525-88d9-6a045ab9bcb6`::ref 0 aborting False >Thread-887::DEBUG::2012-11-29 15:12:34,220::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-887::DEBUG::2012-11-29 15:12:34,220::task::568::TaskManager.Task::(_updateState) Task=`71f09f69-d8c8-4af2-a824-37368b916c2f`::moving from state init -> state preparing >Thread-887::INFO::2012-11-29 15:12:34,220::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-887::DEBUG::2012-11-29 15:12:34,221::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-887::DEBUG::2012-11-29 15:12:34,221::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-887::INFO::2012-11-29 15:12:34,221::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-887::DEBUG::2012-11-29 15:12:34,221::task::1151::TaskManager.Task::(prepare) Task=`71f09f69-d8c8-4af2-a824-37368b916c2f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-887::DEBUG::2012-11-29 15:12:34,222::task::568::TaskManager.Task::(_updateState) Task=`71f09f69-d8c8-4af2-a824-37368b916c2f`::moving from state preparing -> state finished >Thread-887::DEBUG::2012-11-29 15:12:34,222::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-887::DEBUG::2012-11-29 15:12:34,222::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-887::DEBUG::2012-11-29 15:12:34,222::task::957::TaskManager.Task::(_decref) Task=`71f09f69-d8c8-4af2-a824-37368b916c2f`::ref 0 aborting False >Thread-889::DEBUG::2012-11-29 15:12:35,250::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-889::DEBUG::2012-11-29 15:12:35,250::task::568::TaskManager.Task::(_updateState) Task=`fbe2f3d9-9905-4b28-b7ab-6f580169d9fc`::moving from state init -> state preparing >Thread-889::INFO::2012-11-29 15:12:35,250::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-889::DEBUG::2012-11-29 15:12:35,251::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-889::DEBUG::2012-11-29 15:12:35,251::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-889::INFO::2012-11-29 15:12:35,251::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-889::DEBUG::2012-11-29 15:12:35,251::task::1151::TaskManager.Task::(prepare) Task=`fbe2f3d9-9905-4b28-b7ab-6f580169d9fc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-889::DEBUG::2012-11-29 15:12:35,251::task::568::TaskManager.Task::(_updateState) Task=`fbe2f3d9-9905-4b28-b7ab-6f580169d9fc`::moving from state preparing -> state finished >Thread-889::DEBUG::2012-11-29 15:12:35,251::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-889::DEBUG::2012-11-29 15:12:35,252::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-889::DEBUG::2012-11-29 15:12:35,252::task::957::TaskManager.Task::(_decref) Task=`fbe2f3d9-9905-4b28-b7ab-6f580169d9fc`::ref 0 aborting False >Thread-891::DEBUG::2012-11-29 15:12:36,296::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-891::DEBUG::2012-11-29 15:12:36,297::task::568::TaskManager.Task::(_updateState) Task=`06fd683a-b9c4-4f2f-aeed-101cb83f7261`::moving from state init -> state preparing >Thread-891::INFO::2012-11-29 15:12:36,297::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-891::DEBUG::2012-11-29 15:12:36,297::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-891::DEBUG::2012-11-29 15:12:36,297::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-891::INFO::2012-11-29 15:12:36,297::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-891::DEBUG::2012-11-29 15:12:36,297::task::1151::TaskManager.Task::(prepare) Task=`06fd683a-b9c4-4f2f-aeed-101cb83f7261`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-891::DEBUG::2012-11-29 15:12:36,298::task::568::TaskManager.Task::(_updateState) Task=`06fd683a-b9c4-4f2f-aeed-101cb83f7261`::moving from state preparing -> state finished >Thread-891::DEBUG::2012-11-29 15:12:36,298::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-891::DEBUG::2012-11-29 15:12:36,298::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-891::DEBUG::2012-11-29 15:12:36,298::task::957::TaskManager.Task::(_decref) Task=`06fd683a-b9c4-4f2f-aeed-101cb83f7261`::ref 0 aborting False >Thread-892::DEBUG::2012-11-29 15:12:37,326::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-892::DEBUG::2012-11-29 15:12:37,326::task::568::TaskManager.Task::(_updateState) Task=`4db07b39-eb85-4de2-bd43-0fab4e9a0915`::moving from state init -> state preparing >Thread-892::INFO::2012-11-29 15:12:37,326::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-892::DEBUG::2012-11-29 15:12:37,327::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-892::DEBUG::2012-11-29 15:12:37,327::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-892::INFO::2012-11-29 15:12:37,327::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-892::DEBUG::2012-11-29 15:12:37,327::task::1151::TaskManager.Task::(prepare) Task=`4db07b39-eb85-4de2-bd43-0fab4e9a0915`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-892::DEBUG::2012-11-29 15:12:37,327::task::568::TaskManager.Task::(_updateState) Task=`4db07b39-eb85-4de2-bd43-0fab4e9a0915`::moving from state preparing -> state finished >Thread-892::DEBUG::2012-11-29 15:12:37,327::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-892::DEBUG::2012-11-29 15:12:37,327::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-892::DEBUG::2012-11-29 15:12:37,328::task::957::TaskManager.Task::(_decref) Task=`4db07b39-eb85-4de2-bd43-0fab4e9a0915`::ref 0 aborting False >Thread-893::DEBUG::2012-11-29 15:12:38,310::task::568::TaskManager.Task::(_updateState) Task=`c0d23080-ef96-49a1-81ae-258fe8971d85`::moving from state init -> state preparing >Thread-893::INFO::2012-11-29 15:12:38,310::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-893::INFO::2012-11-29 15:12:38,310::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00224900245667', 'lastCheck': '19.8', 'code': 0, 'valid': True}} >Thread-893::DEBUG::2012-11-29 15:12:38,310::task::1151::TaskManager.Task::(prepare) Task=`c0d23080-ef96-49a1-81ae-258fe8971d85`::finished: {'646a3b8e-d5dd-4bf7-be3d-384526eabdd1': {'delay': '0.00224900245667', 'lastCheck': '19.8', 'code': 0, 'valid': True}} >Thread-893::DEBUG::2012-11-29 15:12:38,311::task::568::TaskManager.Task::(_updateState) Task=`c0d23080-ef96-49a1-81ae-258fe8971d85`::moving from state preparing -> state finished >Thread-893::DEBUG::2012-11-29 15:12:38,311::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-893::DEBUG::2012-11-29 15:12:38,311::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-893::DEBUG::2012-11-29 15:12:38,311::task::957::TaskManager.Task::(_decref) Task=`c0d23080-ef96-49a1-81ae-258fe8971d85`::ref 0 aborting False >Thread-895::DEBUG::2012-11-29 15:12:38,354::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-895::DEBUG::2012-11-29 15:12:38,354::task::568::TaskManager.Task::(_updateState) Task=`a974ea56-afd8-4408-88b6-abd5e54eae29`::moving from state init -> state preparing >Thread-895::INFO::2012-11-29 15:12:38,354::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-895::DEBUG::2012-11-29 15:12:38,354::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-895::DEBUG::2012-11-29 15:12:38,354::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-895::INFO::2012-11-29 15:12:38,355::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-895::DEBUG::2012-11-29 15:12:38,355::task::1151::TaskManager.Task::(prepare) Task=`a974ea56-afd8-4408-88b6-abd5e54eae29`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-895::DEBUG::2012-11-29 15:12:38,355::task::568::TaskManager.Task::(_updateState) Task=`a974ea56-afd8-4408-88b6-abd5e54eae29`::moving from state preparing -> state finished >Thread-895::DEBUG::2012-11-29 15:12:38,355::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-895::DEBUG::2012-11-29 15:12:38,355::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-895::DEBUG::2012-11-29 15:12:38,355::task::957::TaskManager.Task::(_decref) Task=`a974ea56-afd8-4408-88b6-abd5e54eae29`::ref 0 aborting False >Thread-896::DEBUG::2012-11-29 15:12:39,382::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-896::DEBUG::2012-11-29 15:12:39,383::task::568::TaskManager.Task::(_updateState) Task=`ae9850cd-7c19-4277-af47-8a114370cf81`::moving from state init -> state preparing >Thread-896::INFO::2012-11-29 15:12:39,383::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-896::DEBUG::2012-11-29 15:12:39,383::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-896::DEBUG::2012-11-29 15:12:39,383::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-896::INFO::2012-11-29 15:12:39,383::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-896::DEBUG::2012-11-29 15:12:39,384::task::1151::TaskManager.Task::(prepare) Task=`ae9850cd-7c19-4277-af47-8a114370cf81`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-896::DEBUG::2012-11-29 15:12:39,384::task::568::TaskManager.Task::(_updateState) Task=`ae9850cd-7c19-4277-af47-8a114370cf81`::moving from state preparing -> state finished >Thread-896::DEBUG::2012-11-29 15:12:39,384::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-896::DEBUG::2012-11-29 15:12:39,384::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-896::DEBUG::2012-11-29 15:12:39,384::task::957::TaskManager.Task::(_decref) Task=`ae9850cd-7c19-4277-af47-8a114370cf81`::ref 0 aborting False >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,789::safelease::178::SANLock::(acquireHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully acquired (id: 1) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::INFO::2012-11-29 15:12:39,790::safelease::211::SANLock::(acquire) Acquiring cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 1) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,825::safelease::235::SANLock::(acquire) Cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully acquired (id: 1) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,826::sp::259::Storage.StoragePool::(startSpm) spm lock acquired successfully >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,828::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=bd78e1b49eb9a0799194190a197f83bd5b88a1c7'] >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,828::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,829::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,829::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=98e1e0b9b770b9e5b5899be112cd79ff9e406fa7'] >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,832::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,832::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`2f54be3c-5fa5-4469-b585-0c864f948cae`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,832::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,833::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,833::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`2f54be3c-5fa5-4469-b585-0c864f948cae`::Granted request >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::INFO::2012-11-29 15:12:39,833::sp::408::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `646a3b8e-d5dd-4bf7-be3d-384526eabdd1` >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,834::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`c4e3dfaa-c5e2-4429-bca6-e1c84552f64c`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,834::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'exclusive' >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,834::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'exclusive' (1 active user) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,834::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`c4e3dfaa-c5e2-4429-bca6-e1c84552f64c`::Granted request >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,835::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,835::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,987::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::WARNING::2012-11-29 15:12:39,988::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,988::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,992::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,993::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,996::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=646a3b8e-d5dd-4bf7-be3d-384526eabdd1:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=98e1e0b9b770b9e5b5899be112cd79ff9e406fa7'] >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,997::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::WARNING::2012-11-29 15:12:39,997::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::WARNING::2012-11-29 15:12:39,998::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,998::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,998::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,998::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,998::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,999::sp::412::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,999::sp::419::Storage.StoragePool::(_upgradePool) Registering with state change event >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,999::sp::421::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:39,999::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,000::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,000::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,000::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,001::sp::309::Storage.StoragePool::(startSpm) ended. >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,001::task::568::TaskManager.Task::(_updateState) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::moving from state running -> state finished >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,002::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>} >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,002::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,002::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,002::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,003::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,003::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,003::task::880::TaskManager.Task::(_runJobs) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::Task.run: exit - success: result >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,003::task::957::TaskManager.Task::(_decref) Task=`603095f3-ec4d-4174-9d25-c4dc9e2cd00d`::ref 0 aborting False >603095f3-ec4d-4174-9d25-c4dc9e2cd00d::DEBUG::2012-11-29 15:12:40,003::threadPool::55::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-899::DEBUG::2012-11-29 15:12:40,411::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-899::DEBUG::2012-11-29 15:12:40,411::task::568::TaskManager.Task::(_updateState) Task=`77229b1e-cb8b-4f46-ab73-3701381e500d`::moving from state init -> state preparing >Thread-899::INFO::2012-11-29 15:12:40,412::logUtils::37::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-899::DEBUG::2012-11-29 15:12:40,412::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-899::DEBUG::2012-11-29 15:12:40,412::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'} >Thread-899::INFO::2012-11-29 15:12:40,412::logUtils::39::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-899::DEBUG::2012-11-29 15:12:40,412::task::1151::TaskManager.Task::(prepare) Task=`77229b1e-cb8b-4f46-ab73-3701381e500d`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '603095f3-ec4d-4174-9d25-c4dc9e2cd00d'}} >Thread-899::DEBUG::2012-11-29 15:12:40,413::task::568::TaskManager.Task::(_updateState) Task=`77229b1e-cb8b-4f46-ab73-3701381e500d`::moving from state preparing -> state finished >Thread-899::DEBUG::2012-11-29 15:12:40,413::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-899::DEBUG::2012-11-29 15:12:40,413::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-899::DEBUG::2012-11-29 15:12:40,413::task::957::TaskManager.Task::(_decref) Task=`77229b1e-cb8b-4f46-ab73-3701381e500d`::ref 0 aborting False >Thread-900::DEBUG::2012-11-29 15:12:40,436::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-900::DEBUG::2012-11-29 15:12:40,437::task::568::TaskManager.Task::(_updateState) Task=`a2831c22-b05e-45bf-b952-eb5c578d4eb9`::moving from state init -> state preparing >Thread-900::INFO::2012-11-29 15:12:40,437::logUtils::37::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-900::INFO::2012-11-29 15:12:40,437::logUtils::39::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-900::DEBUG::2012-11-29 15:12:40,438::task::1151::TaskManager.Task::(prepare) Task=`a2831c22-b05e-45bf-b952-eb5c578d4eb9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-900::DEBUG::2012-11-29 15:12:40,438::task::568::TaskManager.Task::(_updateState) Task=`a2831c22-b05e-45bf-b952-eb5c578d4eb9`::moving from state preparing -> state finished >Thread-900::DEBUG::2012-11-29 15:12:40,438::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-900::DEBUG::2012-11-29 15:12:40,438::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-900::DEBUG::2012-11-29 15:12:40,438::task::957::TaskManager.Task::(_decref) Task=`a2831c22-b05e-45bf-b952-eb5c578d4eb9`::ref 0 aborting False >Thread-901::DEBUG::2012-11-29 15:12:40,464::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-901::DEBUG::2012-11-29 15:12:40,464::task::568::TaskManager.Task::(_updateState) Task=`49482b64-9147-438d-bcb3-6d90eba55cd6`::moving from state init -> state preparing >Thread-901::INFO::2012-11-29 15:12:40,464::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='603095f3-ec4d-4174-9d25-c4dc9e2cd00d', spUUID=None, options=None) >Thread-901::DEBUG::2012-11-29 15:12:40,464::taskManager::161::TaskManager::(clearTask) Entry. taskID: 603095f3-ec4d-4174-9d25-c4dc9e2cd00d >Thread-901::DEBUG::2012-11-29 15:12:40,465::taskManager::166::TaskManager::(clearTask) Return. >Thread-901::INFO::2012-11-29 15:12:40,465::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-901::DEBUG::2012-11-29 15:12:40,465::task::1151::TaskManager.Task::(prepare) Task=`49482b64-9147-438d-bcb3-6d90eba55cd6`::finished: None >Thread-901::DEBUG::2012-11-29 15:12:40,465::task::568::TaskManager.Task::(_updateState) Task=`49482b64-9147-438d-bcb3-6d90eba55cd6`::moving from state preparing -> state finished >Thread-901::DEBUG::2012-11-29 15:12:40,465::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-901::DEBUG::2012-11-29 15:12:40,465::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-901::DEBUG::2012-11-29 15:12:40,466::task::957::TaskManager.Task::(_decref) Task=`49482b64-9147-438d-bcb3-6d90eba55cd6`::ref 0 aborting False >Thread-902::DEBUG::2012-11-29 15:12:40,502::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-902::DEBUG::2012-11-29 15:12:40,502::task::568::TaskManager.Task::(_updateState) Task=`2120a10d-e287-4eca-b66c-1e31ef311686`::moving from state init -> state preparing >Thread-902::INFO::2012-11-29 15:12:40,503::logUtils::37::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', hostID=1, scsiKey='78cd442d-b34f-452c-9bc5-0b69929d8a93', options=None) >Thread-902::INFO::2012-11-29 15:12:40,503::hsm::1035::Storage.HSM::(destroyStoragePool) spUUID=78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-902::DEBUG::2012-11-29 15:12:40,503::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`b40a43c8-9835-4daf-8223-9d648172faec`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-902::DEBUG::2012-11-29 15:12:40,503::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-902::DEBUG::2012-11-29 15:12:40,504::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-902::DEBUG::2012-11-29 15:12:40,504::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`b40a43c8-9835-4daf-8223-9d648172faec`::Granted request >Thread-902::DEBUG::2012-11-29 15:12:40,505::task::794::TaskManager.Task::(resourceAcquired) Task=`2120a10d-e287-4eca-b66c-1e31ef311686`::_resourcesAcquired: Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93 (exclusive) >Thread-902::DEBUG::2012-11-29 15:12:40,505::task::957::TaskManager.Task::(_decref) Task=`2120a10d-e287-4eca-b66c-1e31ef311686`::ref 1 aborting False >Thread-902::DEBUG::2012-11-29 15:12:40,506::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`ef292af4-e626-488b-a467-27be3711260d`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-902::DEBUG::2012-11-29 15:12:40,506::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'exclusive' >Thread-902::DEBUG::2012-11-29 15:12:40,506::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'exclusive' (1 active user) >Thread-902::DEBUG::2012-11-29 15:12:40,506::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`ef292af4-e626-488b-a467-27be3711260d`::Granted request >Thread-902::DEBUG::2012-11-29 15:12:40,507::task::794::TaskManager.Task::(resourceAcquired) Task=`2120a10d-e287-4eca-b66c-1e31ef311686`::_resourcesAcquired: Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (exclusive) >Thread-902::DEBUG::2012-11-29 15:12:40,507::task::957::TaskManager.Task::(_decref) Task=`2120a10d-e287-4eca-b66c-1e31ef311686`::ref 1 aborting False >Thread-902::WARNING::2012-11-29 15:12:40,507::sp::957::Storage.StoragePool::(forcedDetachSD) Force detaching domain `646a3b8e-d5dd-4bf7-be3d-384526eabdd1` >Thread-902::DEBUG::2012-11-29 15:12:40,507::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-902::DEBUG::2012-11-29 15:12:40,508::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-902::DEBUG::2012-11-29 15:12:40,508::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=11e9402a583a4d80e2e930c667bb2cb8aa744cc5'] >Thread-902::DEBUG::2012-11-29 15:12:40,512::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-902::DEBUG::2012-11-29 15:12:40,512::sp::319::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-902::DEBUG::2012-11-29 15:12:40,512::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`21b9482a-4a44-4de6-b2f9-c77c4e56f9da`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-902::DEBUG::2012-11-29 15:12:40,513::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' for lock type 'exclusive' >Thread-902::DEBUG::2012-11-29 15:12:40,513::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' is free. Now locking as 'exclusive' (1 active user) >Thread-902::DEBUG::2012-11-29 15:12:40,513::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93`ReqID=`21b9482a-4a44-4de6-b2f9-c77c4e56f9da`::Granted request >Thread-902::DEBUG::2012-11-29 15:12:40,513::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-902::DEBUG::2012-11-29 15:12:40,514::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-902::DEBUG::2012-11-29 15:12:40,514::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-902::DEBUG::2012-11-29 15:12:40,514::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-902::DEBUG::2012-11-29 15:12:40,514::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-902::DEBUG::2012-11-29 15:12:40,515::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-902::DEBUG::2012-11-29 15:12:40,515::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51b67fc4a8d71895d47e98b68cf5725dd0fd9c69'] >Thread-902::DEBUG::2012-11-29 15:12:40,518::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-902::INFO::2012-11-29 15:12:40,518::safelease::239::SANLock::(release) Releasing cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-902::DEBUG::2012-11-29 15:12:40,520::safelease::250::SANLock::(release) Cluster lock for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 successfully released >Thread-902::DEBUG::2012-11-29 15:12:40,521::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-902::DEBUG::2012-11-29 15:12:40,521::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-902::DEBUG::2012-11-29 15:12:40,524::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51b67fc4a8d71895d47e98b68cf5725dd0fd9c69'] >Thread-861::DEBUG::2012-11-29 15:12:40,524::domainMonitor::153::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-861::INFO::2012-11-29 15:12:40,524::safelease::183::SANLock::(releaseHostId) Releasing host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (id: 1) >Thread-861::DEBUG::2012-11-29 15:12:42,525::safelease::193::SANLock::(releaseHostId) Host id for domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 released successfully (id: 1) >Thread-902::DEBUG::2012-11-29 15:12:42,525::sp::1558::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `78cd442d-b34f-452c-9bc5-0b69929d8a93` stopped monitoring domain `646a3b8e-d5dd-4bf7-be3d-384526eabdd1` >Thread-902::DEBUG::2012-11-29 15:12:42,525::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-902::DEBUG::2012-11-29 15:12:42,526::sp::974::Storage.StoragePool::(forcedDetachSD) Force detach for domain `646a3b8e-d5dd-4bf7-be3d-384526eabdd1` is done >Thread-902::DEBUG::2012-11-29 15:12:42,529::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=78cd442d-b34f-452c-9bc5-0b69929d8a93', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Master', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51b67fc4a8d71895d47e98b68cf5725dd0fd9c69'] >Thread-902::DEBUG::2012-11-29 15:12:42,529::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-902::DEBUG::2012-11-29 15:12:42,529::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-902::DEBUG::2012-11-29 15:12:42,529::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-902::DEBUG::2012-11-29 15:12:42,530::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-902::DEBUG::2012-11-29 15:12:42,530::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e4f8a40ab58da172f79804719b4a86ae6d122d7a'] >Thread-902::DEBUG::2012-11-29 15:12:42,533::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-902::DEBUG::2012-11-29 15:12:42,534::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-902::DEBUG::2012-11-29 15:12:42,534::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-902::DEBUG::2012-11-29 15:12:42,537::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e4f8a40ab58da172f79804719b4a86ae6d122d7a'] >Thread-902::DEBUG::2012-11-29 15:12:42,537::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-902::INFO::2012-11-29 15:12:42,537::sp::664::Storage.StoragePool::(disconnect) Disconnect from the storage pool 78cd442d-b34f-452c-9bc5-0b69929d8a93 >Thread-902::INFO::2012-11-29 15:12:42,538::logUtils::39::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True >Thread-902::DEBUG::2012-11-29 15:12:42,538::task::1151::TaskManager.Task::(prepare) Task=`2120a10d-e287-4eca-b66c-1e31ef311686`::finished: True >Thread-902::DEBUG::2012-11-29 15:12:42,538::task::568::TaskManager.Task::(_updateState) Task=`2120a10d-e287-4eca-b66c-1e31ef311686`::moving from state preparing -> state finished >Thread-902::DEBUG::2012-11-29 15:12:42,538::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93': < ResourceRef 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', isValid: 'True' obj: 'None'>, 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1': < ResourceRef 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', isValid: 'True' obj: 'None'>} >Thread-902::DEBUG::2012-11-29 15:12:42,538::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-902::DEBUG::2012-11-29 15:12:42,539::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' >Thread-902::DEBUG::2012-11-29 15:12:42,539::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' (0 active users) >Thread-902::DEBUG::2012-11-29 15:12:42,539::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93' is free, finding out if anyone is waiting for it. >Thread-902::DEBUG::2012-11-29 15:12:42,539::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78cd442d-b34f-452c-9bc5-0b69929d8a93', Clearing records. >Thread-902::DEBUG::2012-11-29 15:12:42,540::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >Thread-902::DEBUG::2012-11-29 15:12:42,540::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >Thread-902::DEBUG::2012-11-29 15:12:42,540::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >Thread-902::DEBUG::2012-11-29 15:12:42,540::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >Thread-902::DEBUG::2012-11-29 15:12:42,540::task::957::TaskManager.Task::(_decref) Task=`2120a10d-e287-4eca-b66c-1e31ef311686`::ref 0 aborting False >Thread-904::DEBUG::2012-11-29 15:12:42,578::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-904::DEBUG::2012-11-29 15:12:42,578::task::568::TaskManager.Task::(_updateState) Task=`88ae37c4-f788-4317-89b0-9f534e0890ae`::moving from state init -> state preparing >Thread-904::INFO::2012-11-29 15:12:42,578::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-904::DEBUG::2012-11-29 15:12:42,579::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990' (cwd None) >Thread-904::DEBUG::2012-11-29 15:12:42,608::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-904::DEBUG::2012-11-29 15:12:42,608::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-904::DEBUG::2012-11-29 15:12:42,608::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-904::DEBUG::2012-11-29 15:12:42,609::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-904::DEBUG::2012-11-29 15:12:42,609::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-904::DEBUG::2012-11-29 15:12:42,622::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-904::DEBUG::2012-11-29 15:12:42,622::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-904::DEBUG::2012-11-29 15:12:42,624::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-904::DEBUG::2012-11-29 15:12:42,626::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-904::DEBUG::2012-11-29 15:12:42,628::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-904::DEBUG::2012-11-29 15:12:42,630::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-904::DEBUG::2012-11-29 15:12:42,633::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-904::DEBUG::2012-11-29 15:12:42,635::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-904::DEBUG::2012-11-29 15:12:42,637::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-904::DEBUG::2012-11-29 15:12:42,639::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-904::DEBUG::2012-11-29 15:12:44,642::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-904::DEBUG::2012-11-29 15:12:44,694::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-904::DEBUG::2012-11-29 15:12:44,694::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-904::DEBUG::2012-11-29 15:12:44,695::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-904::DEBUG::2012-11-29 15:12:44,695::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-904::DEBUG::2012-11-29 15:12:44,695::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-904::DEBUG::2012-11-29 15:12:44,696::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-904::DEBUG::2012-11-29 15:12:44,696::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-904::DEBUG::2012-11-29 15:12:44,696::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-904::INFO::2012-11-29 15:12:44,696::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-904::DEBUG::2012-11-29 15:12:44,696::task::1151::TaskManager.Task::(prepare) Task=`88ae37c4-f788-4317-89b0-9f534e0890ae`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-904::DEBUG::2012-11-29 15:12:44,697::task::568::TaskManager.Task::(_updateState) Task=`88ae37c4-f788-4317-89b0-9f534e0890ae`::moving from state preparing -> state finished >Thread-904::DEBUG::2012-11-29 15:12:44,697::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-904::DEBUG::2012-11-29 15:12:44,697::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-904::DEBUG::2012-11-29 15:12:44,697::task::957::TaskManager.Task::(_decref) Task=`88ae37c4-f788-4317-89b0-9f534e0890ae`::ref 0 aborting False >Thread-906::DEBUG::2012-11-29 15:12:44,744::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-906::DEBUG::2012-11-29 15:12:44,744::task::568::TaskManager.Task::(_updateState) Task=`4ba5c0e7-1025-484c-9c7f-888f63c0a5f5`::moving from state init -> state preparing >Thread-906::INFO::2012-11-29 15:12:44,744::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='78cd442d-b34f-452c-9bc5-0b69929d8a93', hostID=1, scsiKey='78cd442d-b34f-452c-9bc5-0b69929d8a93', remove=False, options=None) >Thread-906::WARNING::2012-11-29 15:12:44,745::hsm::1001::Storage.HSM::(disconnectStoragePool) disconnect sp: 78cd442d-b34f-452c-9bc5-0b69929d8a93 failed. Known pools {} >Thread-906::INFO::2012-11-29 15:12:44,745::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-906::DEBUG::2012-11-29 15:12:44,745::task::1151::TaskManager.Task::(prepare) Task=`4ba5c0e7-1025-484c-9c7f-888f63c0a5f5`::finished: None >Thread-906::DEBUG::2012-11-29 15:12:44,745::task::568::TaskManager.Task::(_updateState) Task=`4ba5c0e7-1025-484c-9c7f-888f63c0a5f5`::moving from state preparing -> state finished >Thread-906::DEBUG::2012-11-29 15:12:44,745::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-906::DEBUG::2012-11-29 15:12:44,745::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-906::DEBUG::2012-11-29 15:12:44,746::task::957::TaskManager.Task::(_decref) Task=`4ba5c0e7-1025-484c-9c7f-888f63c0a5f5`::ref 0 aborting False >Thread-907::DEBUG::2012-11-29 15:12:45,363::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-907::DEBUG::2012-11-29 15:12:45,363::task::568::TaskManager.Task::(_updateState) Task=`93dfe9c6-7db6-4281-aed9-ee19365a1bae`::moving from state init -> state preparing >Thread-907::INFO::2012-11-29 15:12:45,364::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-907::INFO::2012-11-29 15:12:45,364::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-907::DEBUG::2012-11-29 15:12:45,364::task::1151::TaskManager.Task::(prepare) Task=`93dfe9c6-7db6-4281-aed9-ee19365a1bae`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-907::DEBUG::2012-11-29 15:12:45,364::task::568::TaskManager.Task::(_updateState) Task=`93dfe9c6-7db6-4281-aed9-ee19365a1bae`::moving from state preparing -> state finished >Thread-907::DEBUG::2012-11-29 15:12:45,364::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-907::DEBUG::2012-11-29 15:12:45,365::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-907::DEBUG::2012-11-29 15:12:45,365::task::957::TaskManager.Task::(_decref) Task=`93dfe9c6-7db6-4281-aed9-ee19365a1bae`::ref 0 aborting False >Thread-908::DEBUG::2012-11-29 15:12:45,393::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-908::DEBUG::2012-11-29 15:12:45,393::task::568::TaskManager.Task::(_updateState) Task=`61e87fb5-5ba6-46f4-9c2a-0e9ec231b7e5`::moving from state init -> state preparing >Thread-908::INFO::2012-11-29 15:12:45,394::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-908::DEBUG::2012-11-29 15:12:45,396::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990' (cwd None) >Thread-908::INFO::2012-11-29 15:12:45,423::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-908::DEBUG::2012-11-29 15:12:45,423::task::1151::TaskManager.Task::(prepare) Task=`61e87fb5-5ba6-46f4-9c2a-0e9ec231b7e5`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-908::DEBUG::2012-11-29 15:12:45,423::task::568::TaskManager.Task::(_updateState) Task=`61e87fb5-5ba6-46f4-9c2a-0e9ec231b7e5`::moving from state preparing -> state finished >Thread-908::DEBUG::2012-11-29 15:12:45,424::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-908::DEBUG::2012-11-29 15:12:45,424::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-908::DEBUG::2012-11-29 15:12:45,424::task::957::TaskManager.Task::(_decref) Task=`61e87fb5-5ba6-46f4-9c2a-0e9ec231b7e5`::ref 0 aborting False >Thread-909::DEBUG::2012-11-29 15:12:45,452::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-909::DEBUG::2012-11-29 15:12:45,453::task::568::TaskManager.Task::(_updateState) Task=`37531637-5109-4408-a004-ea4af440132c`::moving from state init -> state preparing >Thread-909::INFO::2012-11-29 15:12:45,453::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='646a3b8e-d5dd-4bf7-be3d-384526eabdd1', autoDetach=False, options=None) >Thread-909::DEBUG::2012-11-29 15:12:45,453::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-909::DEBUG::2012-11-29 15:12:45,453::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-909::DEBUG::2012-11-29 15:12:45,454::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-909::DEBUG::2012-11-29 15:12:45,467::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-909::DEBUG::2012-11-29 15:12:45,467::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:45,469::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:45,471::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:45,473::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:45,475::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:45,477::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:45,479::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:45,481::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:45,483::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-909::DEBUG::2012-11-29 15:12:47,486::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-909::DEBUG::2012-11-29 15:12:47,530::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-909::DEBUG::2012-11-29 15:12:47,531::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`76f268a0-ac43-46c7-ab6f-b0a13d3d6caf`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-909::DEBUG::2012-11-29 15:12:47,531::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' for lock type 'exclusive' >Thread-909::DEBUG::2012-11-29 15:12:47,532::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free. Now locking as 'exclusive' (1 active user) >Thread-909::DEBUG::2012-11-29 15:12:47,532::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1`ReqID=`76f268a0-ac43-46c7-ab6f-b0a13d3d6caf`::Granted request >Thread-909::DEBUG::2012-11-29 15:12:47,533::task::794::TaskManager.Task::(resourceAcquired) Task=`37531637-5109-4408-a004-ea4af440132c`::_resourcesAcquired: Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1 (exclusive) >Thread-909::DEBUG::2012-11-29 15:12:47,533::task::957::TaskManager.Task::(_decref) Task=`37531637-5109-4408-a004-ea4af440132c`::ref 1 aborting False >Thread-909::DEBUG::2012-11-29 15:12:47,537::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e4f8a40ab58da172f79804719b4a86ae6d122d7a'] >Thread-909::DEBUG::2012-11-29 15:12:47,538::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-909::DEBUG::2012-11-29 15:12:47,538::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-909::DEBUG::2012-11-29 15:12:47,538::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-909::DEBUG::2012-11-29 15:12:47,538::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-909::DEBUG::2012-11-29 15:12:47,539::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-909::DEBUG::2012-11-29 15:12:47,554::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-909::DEBUG::2012-11-29 15:12:47,554::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:47,555::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:47,557::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:47,559::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:47,561::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:47,563::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:47,565::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:47,567::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-909::DEBUG::2012-11-29 15:12:47,569::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-911::DEBUG::2012-11-29 15:12:48,510::task::568::TaskManager.Task::(_updateState) Task=`806792c7-f3e7-4a71-a1a7-d731837ba8f2`::moving from state init -> state preparing >Thread-911::INFO::2012-11-29 15:12:48,510::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-911::INFO::2012-11-29 15:12:48,511::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-911::DEBUG::2012-11-29 15:12:48,511::task::1151::TaskManager.Task::(prepare) Task=`806792c7-f3e7-4a71-a1a7-d731837ba8f2`::finished: {} >Thread-911::DEBUG::2012-11-29 15:12:48,511::task::568::TaskManager.Task::(_updateState) Task=`806792c7-f3e7-4a71-a1a7-d731837ba8f2`::moving from state preparing -> state finished >Thread-911::DEBUG::2012-11-29 15:12:48,511::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-911::DEBUG::2012-11-29 15:12:48,511::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-911::DEBUG::2012-11-29 15:12:48,512::task::957::TaskManager.Task::(_decref) Task=`806792c7-f3e7-4a71-a1a7-d731837ba8f2`::ref 0 aborting False >Thread-909::DEBUG::2012-11-29 15:12:49,573::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-909::DEBUG::2012-11-29 15:12:49,614::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-909::DEBUG::2012-11-29 15:12:49,614::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2012-11-29 15:12:49,615::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2012-11-29 15:12:49,615::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2012-11-29 15:12:49,615::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2012-11-29 15:12:49,615::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-909::DEBUG::2012-11-29 15:12:49,616::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-909::DEBUG::2012-11-29 15:12:49,616::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-909::DEBUG::2012-11-29 15:12:49,616::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-909::DEBUG::2012-11-29 15:12:49,617::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (cwd None) >Thread-909::DEBUG::2012-11-29 15:12:49,774::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found\n'; <rc> = 5 >Thread-909::WARNING::2012-11-29 15:12:49,775::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "646a3b8e-d5dd-4bf7-be3d-384526eabdd1" not found'] >Thread-909::DEBUG::2012-11-29 15:12:49,776::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-909::DEBUG::2012-11-29 15:12:49,780::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990/646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-909::DEBUG::2012-11-29 15:12:49,780::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-909::DEBUG::2012-11-29 15:12:49,783::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRestUpd', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DefaultRest', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'ROLE=Regular', 'SDUUID=646a3b8e-d5dd-4bf7-be3d-384526eabdd1', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e4f8a40ab58da172f79804719b4a86ae6d122d7a'] >Thread-909::DEBUG::2012-11-29 15:12:49,784::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-909::WARNING::2012-11-29 15:12:49,784::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_imageNS already registered >Thread-909::WARNING::2012-11-29 15:12:49,785::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 646a3b8e-d5dd-4bf7-be3d-384526eabdd1_volumeNS already registered >Thread-909::INFO::2012-11-29 15:12:49,785::fileSD::404::Storage.StorageDomain::(format) Formatting domain 646a3b8e-d5dd-4bf7-be3d-384526eabdd1 >Thread-909::INFO::2012-11-29 15:12:49,796::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-909::DEBUG::2012-11-29 15:12:49,796::task::1151::TaskManager.Task::(prepare) Task=`37531637-5109-4408-a004-ea4af440132c`::finished: None >Thread-909::DEBUG::2012-11-29 15:12:49,797::task::568::TaskManager.Task::(_updateState) Task=`37531637-5109-4408-a004-ea4af440132c`::moving from state preparing -> state finished >Thread-909::DEBUG::2012-11-29 15:12:49,797::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1': < ResourceRef 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', isValid: 'True' obj: 'None'>} >Thread-909::DEBUG::2012-11-29 15:12:49,797::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-909::DEBUG::2012-11-29 15:12:49,797::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' >Thread-909::DEBUG::2012-11-29 15:12:49,798::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' (0 active users) >Thread-909::DEBUG::2012-11-29 15:12:49,798::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1' is free, finding out if anyone is waiting for it. >Thread-909::DEBUG::2012-11-29 15:12:49,798::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.646a3b8e-d5dd-4bf7-be3d-384526eabdd1', Clearing records. >Thread-909::DEBUG::2012-11-29 15:12:49,798::task::957::TaskManager.Task::(_decref) Task=`37531637-5109-4408-a004-ea4af440132c`::ref 0 aborting False >Thread-915::DEBUG::2012-11-29 15:12:49,830::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-915::DEBUG::2012-11-29 15:12:49,830::task::568::TaskManager.Task::(_updateState) Task=`8743dffe-272d-4f69-a89f-c25827cb7f98`::moving from state init -> state preparing >Thread-915::INFO::2012-11-29 15:12:49,831::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145645359990', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492', 'port': ''}], options=None) >Thread-915::DEBUG::2012-11-29 15:12:49,831::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145645359990' (cwd None) >Thread-915::DEBUG::2012-11-29 15:12:49,860::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-915::DEBUG::2012-11-29 15:12:49,860::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-915::DEBUG::2012-11-29 15:12:49,860::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-915::DEBUG::2012-11-29 15:12:49,861::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-915::DEBUG::2012-11-29 15:12:49,861::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-915::DEBUG::2012-11-29 15:12:49,876::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-915::DEBUG::2012-11-29 15:12:49,876::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-915::DEBUG::2012-11-29 15:12:49,878::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-915::DEBUG::2012-11-29 15:12:49,880::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-915::DEBUG::2012-11-29 15:12:49,883::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-915::DEBUG::2012-11-29 15:12:49,885::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-915::DEBUG::2012-11-29 15:12:49,887::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-915::DEBUG::2012-11-29 15:12:49,889::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-915::DEBUG::2012-11-29 15:12:49,891::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-915::DEBUG::2012-11-29 15:12:49,893::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-915::DEBUG::2012-11-29 15:12:51,896::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-915::DEBUG::2012-11-29 15:12:51,946::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-915::DEBUG::2012-11-29 15:12:51,947::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-915::DEBUG::2012-11-29 15:12:51,947::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-915::DEBUG::2012-11-29 15:12:51,947::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-915::DEBUG::2012-11-29 15:12:51,948::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-915::DEBUG::2012-11-29 15:12:51,948::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-915::DEBUG::2012-11-29 15:12:51,948::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-915::DEBUG::2012-11-29 15:12:51,949::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-915::INFO::2012-11-29 15:12:51,949::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-915::DEBUG::2012-11-29 15:12:51,949::task::1151::TaskManager.Task::(prepare) Task=`8743dffe-272d-4f69-a89f-c25827cb7f98`::finished: {'statuslist': [{'status': 0, 'id': 'af12a0b7-a92c-4f8d-8ec7-e474a9ec2492'}]} >Thread-915::DEBUG::2012-11-29 15:12:51,949::task::568::TaskManager.Task::(_updateState) Task=`8743dffe-272d-4f69-a89f-c25827cb7f98`::moving from state preparing -> state finished >Thread-915::DEBUG::2012-11-29 15:12:51,950::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-915::DEBUG::2012-11-29 15:12:51,950::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-915::DEBUG::2012-11-29 15:12:51,950::task::957::TaskManager.Task::(_decref) Task=`8743dffe-272d-4f69-a89f-c25827cb7f98`::ref 0 aborting False >Thread-917::DEBUG::2012-11-29 15:12:52,565::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-917::DEBUG::2012-11-29 15:12:52,566::task::568::TaskManager.Task::(_updateState) Task=`8ad20998-8773-439e-9ac7-8b202096fc29`::moving from state init -> state preparing >Thread-917::INFO::2012-11-29 15:12:52,566::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-917::INFO::2012-11-29 15:12:52,566::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-917::DEBUG::2012-11-29 15:12:52,567::task::1151::TaskManager.Task::(prepare) Task=`8ad20998-8773-439e-9ac7-8b202096fc29`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-917::DEBUG::2012-11-29 15:12:52,567::task::568::TaskManager.Task::(_updateState) Task=`8ad20998-8773-439e-9ac7-8b202096fc29`::moving from state preparing -> state finished >Thread-917::DEBUG::2012-11-29 15:12:52,567::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-917::DEBUG::2012-11-29 15:12:52,567::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-917::DEBUG::2012-11-29 15:12:52,567::task::957::TaskManager.Task::(_decref) Task=`8ad20998-8773-439e-9ac7-8b202096fc29`::ref 0 aborting False >Thread-918::DEBUG::2012-11-29 15:12:52,596::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-918::DEBUG::2012-11-29 15:12:52,596::task::568::TaskManager.Task::(_updateState) Task=`fdec0e0f-7b16-4db9-ae78-8796d9e4151e`::moving from state init -> state preparing >Thread-918::INFO::2012-11-29 15:12:52,596::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-918::DEBUG::2012-11-29 15:12:52,599::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865 /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865' (cwd None) >Thread-918::INFO::2012-11-29 15:12:52,623::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-918::DEBUG::2012-11-29 15:12:52,624::task::1151::TaskManager.Task::(prepare) Task=`fdec0e0f-7b16-4db9-ae78-8796d9e4151e`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-918::DEBUG::2012-11-29 15:12:52,624::task::568::TaskManager.Task::(_updateState) Task=`fdec0e0f-7b16-4db9-ae78-8796d9e4151e`::moving from state preparing -> state finished >Thread-918::DEBUG::2012-11-29 15:12:52,624::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-918::DEBUG::2012-11-29 15:12:52,624::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-918::DEBUG::2012-11-29 15:12:52,625::task::957::TaskManager.Task::(_decref) Task=`fdec0e0f-7b16-4db9-ae78-8796d9e4151e`::ref 0 aborting False >Thread-920::DEBUG::2012-11-29 15:12:52,652::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-920::DEBUG::2012-11-29 15:12:52,653::task::568::TaskManager.Task::(_updateState) Task=`a34245e0-d90e-4c6a-b857-12a3d4fd1eb6`::moving from state init -> state preparing >Thread-920::INFO::2012-11-29 15:12:52,653::logUtils::37::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', autoDetach=False, options=None) >Thread-920::DEBUG::2012-11-29 15:12:52,653::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-920::DEBUG::2012-11-29 15:12:52,653::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-920::DEBUG::2012-11-29 15:12:52,654::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-920::DEBUG::2012-11-29 15:12:52,668::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-920::DEBUG::2012-11-29 15:12:52,668::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:52,670::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:52,672::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:52,674::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:52,676::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:52,678::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:52,680::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:52,682::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:52,684::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-920::DEBUG::2012-11-29 15:12:54,688::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-920::DEBUG::2012-11-29 15:12:54,729::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-920::DEBUG::2012-11-29 15:12:54,730::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`aa65b631-7ea5-4e11-8b31-746a231e1795`::Request was made in '/usr/share/vdsm/storage/resourceManager.py' line '174' at '__init__' >Thread-920::DEBUG::2012-11-29 15:12:54,731::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' for lock type 'exclusive' >Thread-920::DEBUG::2012-11-29 15:12:54,731::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free. Now locking as 'exclusive' (1 active user) >Thread-920::DEBUG::2012-11-29 15:12:54,731::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76`ReqID=`aa65b631-7ea5-4e11-8b31-746a231e1795`::Granted request >Thread-920::DEBUG::2012-11-29 15:12:54,732::task::794::TaskManager.Task::(resourceAcquired) Task=`a34245e0-d90e-4c6a-b857-12a3d4fd1eb6`::_resourcesAcquired: Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 (exclusive) >Thread-920::DEBUG::2012-11-29 15:12:54,732::task::957::TaskManager.Task::(_decref) Task=`a34245e0-d90e-4c6a-b857-12a3d4fd1eb6`::ref 1 aborting False >Thread-920::DEBUG::2012-11-29 15:12:54,732::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-920::DEBUG::2012-11-29 15:12:54,732::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-920::DEBUG::2012-11-29 15:12:54,732::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-920::DEBUG::2012-11-29 15:12:54,733::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-920::DEBUG::2012-11-29 15:12:54,733::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-920::DEBUG::2012-11-29 15:12:54,747::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-920::DEBUG::2012-11-29 15:12:54,748::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:54,749::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:55,752::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:55,755::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:55,757::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:55,759::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:55,761::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:55,763::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-920::DEBUG::2012-11-29 15:12:55,765::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-920::DEBUG::2012-11-29 15:12:57,768::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-920::DEBUG::2012-11-29 15:12:57,814::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-920::DEBUG::2012-11-29 15:12:57,815::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,815::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,815::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,816::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,816::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,816::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,816::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-920::DEBUG::2012-11-29 15:12:57,817::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,818::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-920::DEBUG::2012-11-29 15:12:57,970::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-920::WARNING::2012-11-29 15:12:57,971::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-920::DEBUG::2012-11-29 15:12:57,971::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,976::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-920::DEBUG::2012-11-29 15:12:57,976::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-920::DEBUG::2012-11-29 15:12:57,979::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=35a3bdebda2a8dcbf11e261e054b10045c044fef'] >Thread-920::DEBUG::2012-11-29 15:12:57,981::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-920::WARNING::2012-11-29 15:12:57,981::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_imageNS already registered >Thread-920::WARNING::2012-11-29 15:12:57,981::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_volumeNS already registered >Thread-920::DEBUG::2012-11-29 15:12:57,984::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=35a3bdebda2a8dcbf11e261e054b10045c044fef'] >Thread-920::DEBUG::2012-11-29 15:12:57,984::lvm::368::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:57,985::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (cwd None) >Thread-920::DEBUG::2012-11-29 15:12:58,136::misc::83::Storage.Misc.excCmd::(<lambda>) FAILED: <err> = ' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found\n'; <rc> = 5 >Thread-920::WARNING::2012-11-29 15:12:58,137::lvm::373::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "c23cb5a0-b4c5-46c1-9bc1-b49800b4de76" not found'] >Thread-920::DEBUG::2012-11-29 15:12:58,137::lvm::397::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-920::DEBUG::2012-11-29 15:12:58,141::fileSD::131::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865/c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-920::DEBUG::2012-11-29 15:12:58,141::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-920::DEBUG::2012-11-29 15:12:58,144::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=DataDomainRest2', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'ROLE=Regular', 'SDUUID=c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=35a3bdebda2a8dcbf11e261e054b10045c044fef'] >Thread-920::DEBUG::2012-11-29 15:12:58,145::fileSD::503::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-920::WARNING::2012-11-29 15:12:58,145::sd::355::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_imageNS already registered >Thread-920::WARNING::2012-11-29 15:12:58,146::sd::363::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace c23cb5a0-b4c5-46c1-9bc1-b49800b4de76_volumeNS already registered >Thread-920::INFO::2012-11-29 15:12:58,146::fileSD::404::Storage.StorageDomain::(format) Formatting domain c23cb5a0-b4c5-46c1-9bc1-b49800b4de76 >Thread-920::INFO::2012-11-29 15:12:58,155::logUtils::39::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-920::DEBUG::2012-11-29 15:12:58,155::task::1151::TaskManager.Task::(prepare) Task=`a34245e0-d90e-4c6a-b857-12a3d4fd1eb6`::finished: None >Thread-920::DEBUG::2012-11-29 15:12:58,155::task::568::TaskManager.Task::(_updateState) Task=`a34245e0-d90e-4c6a-b857-12a3d4fd1eb6`::moving from state preparing -> state finished >Thread-920::DEBUG::2012-11-29 15:12:58,155::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76': < ResourceRef 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', isValid: 'True' obj: 'None'>} >Thread-920::DEBUG::2012-11-29 15:12:58,155::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-920::DEBUG::2012-11-29 15:12:58,156::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' >Thread-920::DEBUG::2012-11-29 15:12:58,156::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' (0 active users) >Thread-920::DEBUG::2012-11-29 15:12:58,156::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76' is free, finding out if anyone is waiting for it. >Thread-920::DEBUG::2012-11-29 15:12:58,156::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.c23cb5a0-b4c5-46c1-9bc1-b49800b4de76', Clearing records. >Thread-920::DEBUG::2012-11-29 15:12:58,157::task::957::TaskManager.Task::(_decref) Task=`a34245e0-d90e-4c6a-b857-12a3d4fd1eb6`::ref 0 aborting False >Thread-926::DEBUG::2012-11-29 15:12:58,190::BindingXMLRPC::161::vds::(wrapper) [10.35.19.68] >Thread-926::DEBUG::2012-11-29 15:12:58,191::task::568::TaskManager.Task::(_updateState) Task=`c05df99b-416d-40a6-9ee8-fff6e5612ed4`::moving from state init -> state preparing >Thread-926::INFO::2012-11-29 15:12:58,191::logUtils::37::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.16.27:/volumes/shafan/jenkins-automation-rpm-vm15_nfs_20121129145647424865', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '4239504e-9cae-4548-8a4e-86d9f674d046', 'port': ''}], options=None) >Thread-926::DEBUG::2012-11-29 15:12:58,191::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.35.16.27:_volumes_shafan_jenkins-automation-rpm-vm15__nfs__20121129145647424865' (cwd None) >Thread-926::DEBUG::2012-11-29 15:12:58,221::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-926::DEBUG::2012-11-29 15:12:58,221::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-926::DEBUG::2012-11-29 15:12:58,221::misc::1025::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-926::DEBUG::2012-11-29 15:12:58,222::misc::1027::SamplingMethod::(__call__) Got in to sampling method >Thread-926::DEBUG::2012-11-29 15:12:58,222::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-926::DEBUG::2012-11-29 15:12:58,236::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-926::DEBUG::2012-11-29 15:12:58,236::misc::1035::SamplingMethod::(__call__) Returning last result >MainProcess|Thread-926::DEBUG::2012-11-29 15:12:58,238::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) >MainProcess|Thread-926::DEBUG::2012-11-29 15:12:58,240::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) >MainProcess|Thread-926::DEBUG::2012-11-29 15:12:58,242::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host2/scan' (cwd None) >MainProcess|Thread-926::DEBUG::2012-11-29 15:12:58,244::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host3/scan' (cwd None) >MainProcess|Thread-926::DEBUG::2012-11-29 15:12:58,246::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host4/scan' (cwd None) >MainProcess|Thread-926::DEBUG::2012-11-29 15:12:58,248::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host5/scan' (cwd None) >MainProcess|Thread-926::DEBUG::2012-11-29 15:12:58,250::misc::83::Storage.Misc.excCmd::(<lambda>) '/bin/dd of=/sys/class/scsi_host/host6/scan' (cwd None) >MainProcess|Thread-926::DEBUG::2012-11-29 15:12:58,252::iscsi::388::Storage.ISCSI::(forceIScsiScan) Performing SCSI scan, this will take up to 30 seconds >Thread-927::DEBUG::2012-11-29 15:12:58,700::task::568::TaskManager.Task::(_updateState) Task=`6366f31d-3afd-4ded-b2a7-4e4d4ae4d952`::moving from state init -> state preparing >Thread-927::INFO::2012-11-29 15:12:58,701::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-927::INFO::2012-11-29 15:12:58,701::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-927::DEBUG::2012-11-29 15:12:58,701::task::1151::TaskManager.Task::(prepare) Task=`6366f31d-3afd-4ded-b2a7-4e4d4ae4d952`::finished: {} >Thread-927::DEBUG::2012-11-29 15:12:58,701::task::568::TaskManager.Task::(_updateState) Task=`6366f31d-3afd-4ded-b2a7-4e4d4ae4d952`::moving from state preparing -> state finished >Thread-927::DEBUG::2012-11-29 15:12:58,701::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-927::DEBUG::2012-11-29 15:12:58,701::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-927::DEBUG::2012-11-29 15:12:58,702::task::957::TaskManager.Task::(_decref) Task=`6366f31d-3afd-4ded-b2a7-4e4d4ae4d952`::ref 0 aborting False >Thread-926::DEBUG::2012-11-29 15:13:00,256::misc::83::Storage.Misc.excCmd::(<lambda>) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-926::DEBUG::2012-11-29 15:13:00,308::misc::83::Storage.Misc.excCmd::(<lambda>) SUCCESS: <err> = ''; <rc> = 0 >Thread-926::DEBUG::2012-11-29 15:13:00,308::lvm::477::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-926::DEBUG::2012-11-29 15:13:00,308::lvm::479::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-926::DEBUG::2012-11-29 15:13:00,309::lvm::488::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-926::DEBUG::2012-11-29 15:13:00,309::lvm::490::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-926::DEBUG::2012-11-29 15:13:00,309::lvm::508::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-926::DEBUG::2012-11-29 15:13:00,310::lvm::510::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-926::DEBUG::2012-11-29 15:13:00,310::misc::1035::SamplingMethod::(__call__) Returning last result >Thread-926::INFO::2012-11-29 15:13:00,310::logUtils::39::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-926::DEBUG::2012-11-29 15:13:00,310::task::1151::TaskManager.Task::(prepare) Task=`c05df99b-416d-40a6-9ee8-fff6e5612ed4`::finished: {'statuslist': [{'status': 0, 'id': '4239504e-9cae-4548-8a4e-86d9f674d046'}]} >Thread-926::DEBUG::2012-11-29 15:13:00,311::task::568::TaskManager.Task::(_updateState) Task=`c05df99b-416d-40a6-9ee8-fff6e5612ed4`::moving from state preparing -> state finished >Thread-926::DEBUG::2012-11-29 15:13:00,311::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-926::DEBUG::2012-11-29 15:13:00,311::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-926::DEBUG::2012-11-29 15:13:00,312::task::957::TaskManager.Task::(_decref) Task=`c05df99b-416d-40a6-9ee8-fff6e5612ed4`::ref 0 aborting False >Thread-930::DEBUG::2012-11-29 15:13:02,808::task::568::TaskManager.Task::(_updateState) Task=`1867a613-662a-4b1c-a37c-736f5af38f8d`::moving from state init -> state preparing >Thread-930::INFO::2012-11-29 15:13:02,808::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-930::INFO::2012-11-29 15:13:02,809::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-930::DEBUG::2012-11-29 15:13:02,809::task::1151::TaskManager.Task::(prepare) Task=`1867a613-662a-4b1c-a37c-736f5af38f8d`::finished: {} >Thread-930::DEBUG::2012-11-29 15:13:02,809::task::568::TaskManager.Task::(_updateState) Task=`1867a613-662a-4b1c-a37c-736f5af38f8d`::moving from state preparing -> state finished >Thread-930::DEBUG::2012-11-29 15:13:02,809::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-930::DEBUG::2012-11-29 15:13:02,809::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-930::DEBUG::2012-11-29 15:13:02,809::task::957::TaskManager.Task::(_decref) Task=`1867a613-662a-4b1c-a37c-736f5af38f8d`::ref 0 aborting False
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 881947
: 654539